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DEPARTMENT  OF  LABOR 

Employment  and  Training  Administration 

(Field  Memorandum  347-77] 

COMPREHENSIVE  MANPOWER 
PROGRAMS 

Guidelines  for  Review  of  Planned 
Performance 

In  order  to  provide  a  common  frame¬ 
work  of  national  and  regional  experi¬ 
ence  against  which  to  compare  perform¬ 
ance  goals  and  to  identify  potential 
problems  with  program  design  and  deliv¬ 
ery,  the  Department  of  Labor  has  de¬ 
veloped  guidelines  to  review  prime  spon¬ 
sors’  planned  performance  for  Fiscal 
Year  1978  under  title  I  of  the  Compre¬ 
hensive  Employment  and  Training  Act 
(CETA)  of  1973,  as  amended. 

The  entire  text  of  Field  Memoran¬ 
dum  No.  347-77  is  published  here  to  in¬ 
form  all  interested  parties  of  the  Depart¬ 
ment’s  review  procedures. 

[Field  Memorandum  No.  347-77] 

To:  All  Regional  Administrators 

From  :  Flotd  E.  Edwards 

Administrator,  Field  Operations 

Subject:  CETA  Title  I  Review  Guidelines 
for  FY  1978 

1.  Purpose.  To  transmit  guidelines  for  the 
review  of  CETA  title  I  annual  plans  for  FT 
1978. 

2.  Reference.  FM  209-77. 

3.  Background.  Grant  review  guidelines 
were  Implemented  for  the  first  time  in  the 
review  of  FY  1977  CETA  title  I  grant  appli¬ 
cations.  Much  of  the  criticism  of  this  initial 
effort  was  directed  toward  the  technical  ade¬ 
quacy  of  the  indicators  themselves  and  the 
fact  that  participation  in  decisions  relating 
to  the  choice  and  use  of  the  indicators  was 
limited.  In  response  to  this,  a  work  group, 
consisting  of  one  prime  sponsor  from  each 
region  and  one  representative  from  each  re¬ 
gional  office,  was  created  to  identify  the  best 
indicators  to  measure  performance  and  to 
define  methods  of  computation,  given  the 
constraints  of  the  existing  data  system.  Ad¬ 
ditional  projects  related  to  the  use  of  the 
indicators,  including  grant  review  guidelines 
and  FY  1978  performance  assessment,  were 
also  planned.  The  group  produced  a  final 
document  (FM-209-77)  setting  forth  13  per¬ 
formance  indicators,  grouped  into  four  clus¬ 
ters  and  related  interpretive  factors.  The 
cluster  approach  was  used  since  CETA  rep¬ 
resents  a  multiplicity  of  goals  and  objectives 
for  which  no  one  performance  indicator  can 
adequately  measure  the  effectiveness  of  a 
local  program. 

A  subgroup  was  designated  to  analysre  the 
data  and  propose  a  mechanism  to  assist  in 
the  review  of  FY  1978  annual  plans.  The  sub¬ 
group  consisted  of  three  prime  sponsor  rep¬ 
resentatives  and  three  regional  office  renre- 
sentatlves,  from  the  larger  groun,  as  well  as 
two  national  office  representatives. 

4.  Objectives  and  Mechanism  of  Review 
Guidelines.  The  primary  objective  of  such 
a  tool  is  to  provide  a  common  framework 
against  which  prime  sponsors  and  regional 
offices  can  compare  FY  1978  annual  plans  and 
performance  goals  to  national  and  regional 
experience.  The  subgroup  developed  a  re¬ 
view  mechanism  to  compare  planned  per¬ 
formance  with  actual  national  and  regional 
experience,  based  on  the  performance  in¬ 
dicators  developed  by  the  larger  group.  This 
mechanism  is  to  be  followed  in  the  review 
of  FY  1978  title  I  annual  plans. 
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Data  for  eacle  Indicator  will  be  displayed 
In  terms  of  lowest  and  highest  performance, 
median  (mid-point)  and  first  and  third 
quartUes  on  both  a  national  and  regional 
level.  The  exact  meaning  of  median  and 
quartile  is  in  section  6(b)  of  this  memo¬ 
randum,  and  in  Attachment  I,  section  I.A. 

Planned  performance  In  relat.onshlp  to 
the  regional  median  and  trend  toward  the 
first  or  third  quartile  will  be  emphasized  In 
the  plan  review.  Each  indicator  cluster  will 
Include  a  list  of  factors  the  presence  or  ab¬ 
sence  of  which  may  affect  performance  in 
either  direction  from  the  median.  Such  a 
list  is  not  Intended  to  be  all  inclusive  nor 
is  it  Intended  to  substitute  for  the  knowl¬ 
edge  of  a  Federal  Representative  and  prime 
sponsor  staff  about  the  appropriateness  of 
a  plan. 

The  data  displays  are  intended  to  provide 
a  good  starting  point  from  which  to  identify 
potential  problems  with  program  design  and 
delivery  before  they  are  reflected  in  poor  pei*- 
formance. 

The  review  guldeimes  are  rvot  to  be  consid- 
dered  as  performance  standards.  The  me¬ 
dian  and  other  reference  points  of  regional 
and  national  experience  served  only  as  con¬ 
venient  benchmarks  against  which  prime 
sponsors'  plans  can  be  reviewed  and  ana¬ 
lyzed. 

5.  Indicators.  The  Indicators  to  be  used  as 
the  basis  for  the  review  of  FY  1978  title  I  cm- 
nual  plans  are  those  developed  by  the  Per¬ 
formance  Indicators  Work  Group  published 
In  the  Federal  Register.  However,  several 
indicators  have  been  excluded  from  this 
exercise;  these  are  in  the  earnings  cluster, 
for  which  no  information  is  available  in  the 
planning  documents,  and  the  expenditure 
rate  in  the  fund  utilization  cluster,  because 
it  is  the  complement  of  the  carry-out  rate 
included  in  these  review  guidelines.  The  fol¬ 
lowing  Indicators  have  been  Included. 

a.  Termination  Cluster 
Positive  Termination  Rate 

Entered  Employment  Rate — ^Total  Ter¬ 
minations  Based 

Entered  Employment  Rate — ^Total  Posi¬ 
tive  Terminations  Based 
Nondlrect  Placement  Rate — ^Total  Ter¬ 
minations  Based 

Nondlrect  Placement  Rate — Total  En¬ 
tered  Employment  Based 

b.  Cost  Cluster 

Cost  Per  Positive  Termination 
Cost  Per  Entered  Employment 
Cost  Per  Nondlrect  Placement 

c.  Fund  Utilization  Cluster 
Carry-out  Rate 
Administrative  Cost  Rate 

A  description  and  method  of  computation  for 
each  Indicator  are  included  in  Attachment  U. 

6.  Description  of  Data. 

a.  Data  Base.  Data  covering  FY  1976  and 
the  transition  quarter,  for  431  prime  spon¬ 
sors,  were  used  to  compute  the  10  indicators 
and  to  determine  national  and  regional 
medians,  quartlles  and  high  and  low  per¬ 
formance  against  which  the  prime  sponsor’s 
planned  performance  will  be  compared.  The 
data  were  obtained  from  the  CETA  Program 
Status  Summary  (PSS).  Financial  Status  Re¬ 
port  (FSR)  and  obligations  contained  in  the 
Grant  Signature  Sheet  and  modifications. 
Data  from  these  documents  are  reclved  in 
the  national  office  through  the  Regional  Au¬ 
tomated  System  (RAS) . 

This  is  the  latest  data  for  a  full  program 
year  that  will  be  available  in  time  for  the 
FY  1978  annual  plan  review  which  is  to  take 
place  during  the  fourth  quarter  of  FY  1977. 
A  full  program  year  was  selected  instead  of 
a  combination  of  FY  1976  and  FY  1977  to 
provide  later  data  for  a  12-month  period 
because  activities  associated  with  a  new  year 


would  distort  termination  and  cost  data. 
Also,  there  would  be  no  basis  for  determining 
a  carry-out  rate. 

Data  for  the  base  period  were  obtained  by 
a  special  RAS  computer  run  from  reports  in 
the  system  through  November  30,  1976.  Miss¬ 
ing  data  were  obtained  from  later  regular 
RAS  computer  runs,  or  from  special  runs. 
Substantially,  all  of  the  PSS  and  FSR  data 
are  in  the  final  RAS/QPR  run  for  the  sub¬ 
ject  period  dated  December  10,  1976.  Due  to 
the  carry  out  of  unexpended  funds  into  FY 
1977,  ftmd  availability  was  understated  for  a 
number  of  prime  sponsors.  In  these  cases 
an  upward  adjustment  was  made. 

b.  Computation  of  QuartUes  and  Medians. 
The  performance  of  each  prime  sponsor  was 
computed  for  each  of  the  10  indicators.  The 
results  expressed  as  a  percent  or  dollars  were 
then  arrayed  in  ascending  order  regionally 
and  nationally  starting  with  the  prime  spon¬ 
sor  with  the  lowest  computed  value  to  the 
prime  qxinsor  with  the  highest  computed 
value.  This  array  was  divided  into  four  equal 
parts,  each  part  containing  the  performance 
of  26  percent  of  all  prime  sponsors. 

The  boundary  dividing  the  lower  half  of 
the  array  into  two  quarters,  each  containing 
36  percent  of  the  qionsors,  is  designated  as 
the  first  quartile  (Q,).  The  boundary  divid¬ 
ing  the  array  in  half  is  designated  as  the 
median  (M)  or  second  quartile.  The  bound¬ 
ary  dividing  the  upper  half  of  the  array  in 
two  quarters,  each  containing  25  percent  of 
sponsors  is  designated  as  the  third  quartile 
(Q,).  The  quartile  divisions  serve  as  con¬ 
venient  reference  points  in  the  array  against 
which  to  compare  prime  sponsor  planning 
goals. 

c.  Interpretive  Factors.  Data  for  interpre¬ 
tive  factors  preprinted  in  the  interpretive 
factor  worksheet  (see  Attachment  I)  include 
selected  client  characteristics.  pre-CETA  and 
post-CETA  median  wages,  percent  of  cumu¬ 
lative  enrollment  by  activity,  percent  of  ac¬ 
crued  expenditures  by  activity  and  the  local 
unemployment  rate.  Data,  except  for  the 
local  unemployment  rate,  were  obtained  from 
the  PSS  for  enrollment,  the  FSR  for  accrued 
expenditures  and  the  Quarterly  Summary  of 
Participant  Characteristics  (QSPC)  for  char¬ 
acteristics  and  wage  data.  The  data  base  for 
these  factors,  as  for  the  performance  indi¬ 
cators.  include  cumulative  data  for  FY  1976 
and  the  transition  quarter.  Prime  sponsor 
data  will  be  compared  against  the  national 
and  regional  totals  from  the  final  RAS  print¬ 
out  for  this  period  dated  December  10,  1976. 
For  comparison,  the  Federal  Representative 
should  fill  in  the  appropriate  data  in  the 
interpretive  factor  worksheet  for  the  prime 
sponsor  under  review  to  explain  program  per¬ 
formance.  Instructions  for  completing  "spon¬ 
sor”  column  are  in  the  worksheets.  Attach¬ 
ment  I,  section  n. 

7.  Application  of  refview  guidelines.  There 
are  separate  worksheets  for  each  of  the  in¬ 
dicator  clusters  and  a  worksheet  for  the  in¬ 
terpretive  factors  to  be  utilized  in  annual 
plan  reviews.  See  Attachment  I  for  an  ex¬ 
planation  of  the  five  reference  points  and 
instructions  for  the  use  of  the  worksheets. 

In  reviewing  prime  sponsor  planning  goals, 
the  following  procedures  should  apply: 

a.  Computation  of  Planning  Goals.  The 
Federal  R^resentatlve  should  first  compute 
the  FY  1978  performance  goals  tor  each  of 
the  indicators  in  the  three  performance  clus¬ 
ters  by  substituting  cumulative  planning 
data  through  the  fourth  quarter  from  the 
PPS  and  BIS  of  the  annual  plan  for  the  data 
elements  of  the  formulas  in  the  worksheets. 
The  computed  values  should  be  placed  in  the 
“results”  column  of  the  worksheets. 

b.  Comparison  to  Regional  Median. 
Planned  perfomance  in  relation  to  the  re¬ 
gional  median  will  be  emphasized  in  the 
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review  process  for  each  Indicator  In  the  per¬ 
formance  clusters  to  determine  If  significant 
deviation  requires  an  explanation.  The  na¬ 
tional  reference  points  show  the  relationship 
between  prime  sponsor  planning  goals  and 
regional  and  national  experience.  Use  of  re¬ 
gional  comparative  data  as  the  reference 
points  against  which  prime  sponsor  plans 
are  to  be  compared  to  determine  significant 
deviation  takes  Into  account  programmatic 
and  other  factors  unique  to  a  particular  re¬ 
gion,  thereby  ensuring  equitable  treatment 
for  as  many  prime  sponsors  eia  possible. 

c.  Significant  Deviations  from  the  Median. 
In  general,  planned  performance  close  to 
the  middle  of  the  comparative  data  (median) 
need  not  be  explained.  However,  planned 
performance  as  Indicated  on  the  FPS  and 
BIS  should  be  consistent  with  the  program 
narrative  In  the  annual  plan.  In  addition, 
planned  performance  falling  above  the  re¬ 
gional  median  for  the  "termination  clus¬ 
ter”  and  below  the  regional  median  for  the 
“cost  cluster”  and  the  administrative  cost 
rate  In  the  "fund  utilization  cluster”  may 
not  need  explanation.  Higher  than  median 
positive  outcome  rates,  lower  than  median 
costs  for  positive  outcomes  and  adminis¬ 
trative  cost  rates  generally  Indicate  desir¬ 
able  performance  and  should  not  require 
explanation  unless  there  are  programmatic 
or  other  reasons  for  doing  so.  Because  the 
carry-out  rate  of  the  "fund  utilization  clus-* 
ter"  is  high  for  many  regions,  an  explana¬ 
tion  may  be  required  for  significant  devia¬ 
tion  below  the  regional  median  to  be  de¬ 
termined  by  the  RA,  see  7.c.(l)  below.  In 
conducting  the  review  of  the  annual  plan, 
the  following  should  be  observed  concerning 
significant  deviation  from  the  median. 

(1)  Significant  Deviation  from  the  Median 
which  may  not  Require  Explanation.  The 
review  process  Is  designed  to  examine  closely 
planned  performance  below  the  first  quartile 
or  above  the  third  quartile,  depending  on 
the  Indicator  or  cluster  being  reviewed.  BA’s 
should  not  require  written  explanation  of 
prime  sponsor  planning  goals  which  deviate 
from  the  regional  median  to  and  Including 
the  first  quartile  for  Indicators  In  the  "ter¬ 
mination  cluster,”  and  the  carry-out  rate  In 
the  “fund  utilization  cluster,”  and  from  the 
regional  median  to  and  Including  the  third 
quartile  for  Indicators  In  the  “cost  cluster” 
and  the  "fund  utilization  cluster.”  BA's  may 
request  an  explanation  of  planned  per¬ 
formance  within  the  limits  outlined  above 
when,  the  reviewer  believes  the  planning 
goals  are  unrealistic  or  serious  program¬ 
matic  problems  are  evident.  This  may  In¬ 
clude  planned  performance  which  differs  sub¬ 
stantially  from  previous  performance  with¬ 
out  a  significant  change  occmrlng  In  pro¬ 
gram  operations  or  planned  performance 
which  may  not  be  achieved  because  of 
serious  administrative,  managerial  or  fiscal 
problems.  The  BA  may  determine  appro¬ 
priate  situations  and  the  amount  of  detail 
required  for  any  explanation.  The  most  Im¬ 
portant  thing  Is  consistency  between  the 
program  narrative  and  whatever  per¬ 
formance  is  planned.  Therefore,  even  though 
an  explanation  of  deviation  from  the  median, 
may  not  be  required,  consistency  should  be 
Insured. 

(2)  Significant  Deviations  from  the  Median 
for  Which  an  Explanation  is  Mandatory. 
Where  planned  performance  deviates  from 
the  median  to  fall  below  the  first  quartile 
(Q,)  for  Indicators  In  the  “termination 
cluster”  and  above  the  third  quartile  (Q,) 
for  Indicators  in  the  "fund  utilization  clus¬ 
ter”  and  "cost  cluster,”  an  explanation/ Jus¬ 
tification  will  be  required.  This  explanation 
must  be  as  complete  and  detailed  as  possible. 

Significant  deviations  from  the  median 
where  an  explanation  is  mandatory  or  may 


be  required  as  determined  by  the  BA,  should 
be  explained  by  the  absence  or  presence  of 
environmental,  programmatic  and  other  lo¬ 
cally  relevant  situations  which  may  Influ¬ 
ence  performance  from  the  median.  These 
factors  will  be  discussed  In  Item  8  of  this 
FM. 

d.  Incremental  Improvement.  In  evaluat¬ 
ing  plans  for  FT  1978,  an  additional  key  ele¬ 
ment  to  be  considered  is  each  sponsor’s  i»e- 
vlous  performance.  Ihe  concept  of  Incre¬ 
mental  improvement  Is  critical  to  reviewing 
a  sponsOT’s  plan.  To  determine  the  extent 
of  Improvement  over  previous  performance. 
Federal  Bepresentatlves  should  compute  the 
sponsor’s  actual  achievement  for  each  of  the 
indicators,  using  the  most  recent  data  avail¬ 
able  In  the  regional  office.  Where  a  prime 
sponsor’s  plan  deviates  significantly  from 
the  median,  but  reasonable  Improvement 
over  previous  performance  Is  planned,  such 
Improvement  may  serve  as  adequate  expla¬ 
nation  for  deviations.  A  prime  sponsor  per¬ 
forming  above  the  median  for  the  termina¬ 
tion  cluster  and  below  It  for  the  others, 
should  not  be  permitted  "slippage”  unless 
there  has  been  a  drastic  change  In  local 
conditions.  In  fact,  such  sponsors  may  be 
expected  to  improve  on  their  performance. 

e.  Special  Considerations  in  the  Review. 
Because  of  the  nature  of  the  data  for  a  few 
Indicators,  the  following  Information  Is  pro¬ 
vided  for  your  consideration: 

(1)  For  the  carry-out  rate  of  the  “fund 
utilization  cluster,”  FY  1976  and  the  transi¬ 
tion  quarter  national  and  regional  experi¬ 
ence  upon  which  the  gxildellnes  are  based 
Indicate  median  carry-out  rates  of  11  per¬ 
cent  or  greater  nationally  and  for  nine  of 
the  ten  regions.  This  would  Indicate  that 
expenditures  for  FY  1976  and  the  transition 
quarter  were  on  the  low  side  resulting  In 
a  large  carry-out  of  fimds  Into  FY  1977. 
While  It  Is  recognized  that  a  certain  amount 
of  funds  may  be  necessary  to  be  carried  out 
Into  the  following  year  providing  for  a 
smooth  transition  of  the  program,  this 
should  be  kept  to  a  minimum.  Therefore, 
explanation  of  deviation  from  the  median 
below  to  the  first  quartile  and  above  to  the 
third  quui:lle  may  be  requested  as  deter¬ 
mined  by  the  BA.  An  explanation  for  devia¬ 
tion  above  the  third  quartile  Is  mandatory. 
Additionally,  comparison  should  always  be 
made  with  the  carry-out  rate  of  previous 
experience.  If  the  planning  goal  significantly 
deviates  from  the  median,  but  a  reasonable 
improvement  In  the  carryout  rate  Is  planned 
when  compared  to  the  actual  carry-out  rate 
for  FY  1976  and  the  transition  quarter,  no 
further  explanation  may  be  necessary. 

(2)  For  the  administrative  cost  rate  In 
the  “fund  utilization  cluster,”  the  regula¬ 
tions  already  mandate  an  adequate  explana¬ 
tion  with  supporting  documentation  If  the 
planned  rate  exceeds  20  percent.  It  is  sug¬ 
gested  that  explanation  for  significant  devi¬ 
ation  should  not  be  required  above  the  me¬ 
dian  feu:  the  planning  goal  until  it  exceeds 
20  percent.  In  all  regions,  administrative 
cost  rates  above  20  percent  will  fall  above 
the  third  quartile  (^)  and  will  require  an 
explanation  as  complete  and  detailed  as 
possible.  The  documentation  contained  in 
the  annual  plan  should  be  cited  If  this  Is 
adeq\iate. 

8.  Interpretive  Descriptions  and  Interpre¬ 
tive  Factors.  Each  performance  cluster  work¬ 
sheet  (see  Attachment  I  to  this  FM)  con¬ 
tains  a  preprinted  list  of  programmatic  and 
environmental  factors,  under  the  heading 
of  Interpretive  Descriptions,  which  may  be 
of  assistance  In  explaining,  or  raising  ques¬ 
tions  about  prime  sponsor  planned  perform¬ 
ance.  The  list,  located  in  the  lower  left 
side  of  each  worksheet.  Is  not  Intended  to  be 
all  inclusive.  The  Federal  Representative  may 
be  aware  of  other  factors  unlque^to  the  re¬ 


gion  or  prime  sponsor  area  that  could  ex¬ 
plain  plaimed  performance.  Among  the  In¬ 
fluential  factors  (whether  or  not  listed  In 
the  interpretive  descr4>tlon  section  of  the 
attached  clxister  worksheets)  are  those  deal¬ 
ing  with  the  prime  sponsor’s  program  mix, 
enrollee  characteristics,  enrollee  pre-CETA 
and  post-CETA  wages,  and  the  local  unem¬ 
ployment  rate. 

These  factors  are  all  quantifiable  and  are 
designated  as  Interpretive  factors.  They  are 
contained  on  a  separate  worksheet  In  Attach¬ 
ment  I  for  convenience  of  comparing  these 
factors  and  using  them  In  combination  to 
explain  a  significant  deviation.  Since  these 
factors,  except  for  enrollee  wages  and  the 
local  unemployment  rate,  can  be  broken 
down  by  their  proportion  of  the  prime  spon- 
SOT’s  total  program,  each  factor  can  be  com¬ 
pared  with  other  elements  of  the  sponsor’s 
program  and  regional  experience  data. 

The  Interpretive  factors  worksheet  will 
contain  r^onal  and  national  experience  data 
for  FY  ’76  and  the  transition  quarter  which 
has  been  preprinted  on  the  worksheets.  Prime 
sponsor  data  to  be  compared  within  the  pro¬ 
gram  and  with  regional  totals  will  be  filled  In 
by  the  Federal  Representative  In  a  column 
marked  "sponsor.”  (See  Attachment  I,  sec¬ 
tion  n,  for  additional  instructions.) 

The  right  side  of  the  worksheet  contains 
a  short  presentation  on  the  vise  of  each  of 
the  Interpretive  factor  groups.  This  presenta¬ 
tion  Is  limited  but  Is  Included  to  give  the 
Federal  Representative  an  understanding  of 
how  the  various  Interpretive  factors  may  be 
used.  The  following  examples  provide  the 
Federal  Representative  with  a  fuller  range 
of  Implications  that  these  factors  may  have 
on  planned  performance: 

a.  Enrollee  Characteristics.  The  Federal 
Representative  should  pay  particular  atten¬ 
tion  to  the  tirpes  of  participants  to  be  en¬ 
rolled  in  the  program  and  the  possible  corre¬ 
lations  to  the  percent  of  expenditures,  cu¬ 
mulative  erollments  by  program  activity, 
planned  performance  goals,  and  program  ob¬ 
jectives.  Prime  sponsors  may  develop  and 
operate  programs  designed  to  Increase  the 
employability  of  particular  groups  of  enroll- 
ees,  with  placement  In  unsubsidized  employ¬ 
ment  not  being  a  program  objective.  A  prime 
sponsor  proposing  to  serve  a  significant  num¬ 
ber  of  youth  and  full-time  students  may  be 
expected  to  allocate  a  sizeable  portion  of 
funds  for  work  experience  activities  and  have 
a  sizeable  percentage  of  enrollments  In  work 
experience  activities,  accompanied  by  a  rela¬ 
tively  low  planned  “entered  employment 
rate,  a  relatively  high  planned  “cost  per  en¬ 
tered  empolyment,”  and  a  relatively  high 
planned  "positive  termination”  rate.  The 
Federal  Representative  should  then  compare 
planned  p^ormance  goals  for  the  affected 
indicators  against  regional  comparative  data 
for  the  interpretive  factors.  This  comparison 
may  explain  significant  deviations. 

Prime  sponsors  operating  programs  or 
activities  stressing  service  to  other  groups, 
generally  considered  to  be  “hard  to  place,” 
e.g.,  minorities,  persons  with  limited  English- 
speaking  ability,  older  workers  and  handi¬ 
capped,  may  be  expected  to  propose  relatively 
low  positive  termination  rates  through  fre¬ 
quent  turnover,  low  entered  employment 
rates,  high  costs  per  positive  termination  and 
high  costs  per  entered  employment. 

b.  Program  Mix.  Prime  sponsors  may  plan 
to  allocate  a  sizeable  portion  of  funds  to 
classroom  training  and  OJT.  ’These  are  place¬ 
ment-related  activities  and  planned  perform¬ 
ance  should  reflect  this.  Planned  goals  for 
other  Indicators  may  be  similarly  affected  by 
such  a  distribution  of  funds.  ’The  Federal 
Representative  should  review  regional  data 
for  the  affected  indicators  and  the  interpre¬ 
tive  factors  for  possible  explanation  of  the 
sponsor’s  planned  performance. 

The  interpretive  factors  and  other  environ¬ 
mental  and  programmatic  Influences,  must 
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be  used  with  care.  Although  there  may  be  a 
precedent  to  draw  certain  conclusions  from 
an  established  correlation  of  some  of  these 
with  the  planning  goals,  the  danger  Is  to 
rationalize  relationships  for  others  where  the 
correlation  is  weak  or  does  not  exist.  It  will 
be  Incumbent  on  the  Federal  Representative, 
who  Is  knowledgeable  concerning  the  en¬ 
vironmental  and  programmatic  aspects  of  the 
prime  sponsor,  to  make  Judgments  as  to  the 
factors  and  the  strength  of  the  factors  con¬ 
sidered  to  be  operating  to  determine  If  they 
are  adequate  to  explain  planned  perform¬ 
ance.  Where  an  explanation  for  deviation 
from  the  median  is  required.  It  should  be 
documented  with  appropriate  backup  in  the 
annual  plan  and  by  Information  available 
from  other  sovirces.  Again,  consistency  be¬ 
tween  the  narrative  and  planned  perform¬ 
ance  Is  Imperative.  Regional  offices  may  wish 
to  establish  “review”  committees  to  assure 
consistency  In  the  application  of  the  Inter¬ 
pretive  Influences  on  a  regional  level.  Prime 
sponsors  with  similar  proflles  on  the  Inter¬ 
pretive  influences  could  be  reviewed  together 
to  determine  whether  legitimate  explana¬ 
tions  for  program  deviations  In  plann^  per¬ 
formance  goals  exist. 

9.  Training. 

a.  Federal  Stalf.  In  order  to  ensure  a  uni¬ 
form  understanding  of  how  to  apply  the 
guidelines  In  your  region.  It  Is  recommended 
that  regional  staff  be  trained  as  early  as  pos¬ 
sible.  The  national  office  has  contacted  re¬ 
gional  offices  offering  them  assistance  in 
training.  For  those  regions  accepting,  ar¬ 
rangements  were  made  for  selected  members 
of  the  review  guidelines  work  group  and  a 
member  of  the  performance  Indicators  work 
group  to  assist  In  training  in  the  regions. 

b.  Prime  Sponsor.  Prime  sponsors  should  be 
provided  with  a  copy  of  the  review  guidelines 
memorandum  and  attachments  as  early  as 
possible  to  become  aware  of  how  their  plans 
will  be  reviewed.  Whether  prime  sponsors 
are  called  together  for  a  general  orientation 
to  the  guidelines  or  the  Federal  Representa¬ 
tives  review  the  guidelines  with '  them  In¬ 
dividually  should  be  decided  by  the  RA. 

10.  Action  Required.  RAs  should  distribute 
this  FM  as  soon  as  possible  to  regional  staff, 
prime  sponsors  and  any  other  person  requir¬ 
ing  this  Information.  They  should  also  In¬ 
form  prime  sponsors  and  others  that  these 
guidelines  will  be  published  in  the  Federal 
Register. 

11.  Inquiries.  Questions  should  be  directed 
to  Henry  Rosenbloom  or  Rlc  Campbell  on 
8-376-6390. 

12.  Attachments.  (RAs  only.) 

I.  Worksheets. 

n.  Description  of  Indicators. 

Attachment  I 
WORKSHEETS 

I.  Performance  Cluster  Worksheets.  Sepa¬ 
rate  worksheets  have  been  developed  fro  each 
of  the  Indicator  clusters  which  Include  a  Ust 
of  Interpretive  environmental  and  program¬ 
matic  factOTs  to  be  utilized  In  plan  reviews. 
The  following  will  describe  the  format  of  the 
cluster  worksheets  and  general  procedure  for 
review. 

A.  The  upper  part  of  each  worksheet  lists 
the  component  parts  of  the  cluster,  the  com¬ 
putation  formula;  and  a  space  for  entering 
planned  outcomes  for  the  prime  sponsor  be¬ 
ing  reviewed.  Next  to  the  planned  result, 
comparative  data,  to  be  used  as  reference 
points  In  either  percents  or  dollars,  will  be 
preprinted.  The  comparative  data  will  be  dis- 
reglons.  Five  reference  points  will  be  In¬ 
cluded. 

1.  Lowest  Performance  (L). 

2.  First  Quartlle  (Q,). 

3.  Median  (Mid  Point)  (M) . 

4.  Third  Quartlle  (Q,). 

6.  Highest  Performance  (H) . 


The  first  quartlle  refers  to  Uie  point  whlcdi 
25  percent  of  the  prime  sponsors  fall  below  In 
peirformance. 

The  third  quartlle  refers  to  the  point  In 
performance  where  25  percent  of  the  spon¬ 
sors  fall  above. 

(Ihe  flrst  and  third  quartUes  represent 
boundaries  which  Include  the  middle  50  per¬ 
cent,  in  terms  of  performance,  of  prime  spon¬ 
sors.) 

In  reviewing  the  plan  the  regional  median 
will  be  used  as  the  main  reference  point  by 
the  Federal  Representative  (see  Item  7.b  of 
FM).  Significant  deviations  above  or  below 
the  median,  depending  on  the  performance 
cluster,  should  be  analyzed  In  terms  of  var¬ 
ious  interpretive  environmental  and  pro¬ 
grammatic  factors. 

B.  The  bottom  left  band  side  of  the  work¬ 
sheets  will  contain  a  list  of  Interpretive  de¬ 
scriptions.  These  consist  of  environmental 
and  programmatic  factors  the  presence  or 
absence  of  which  may  Influence  p^ormance. 
These  will  be  used  as  a  basis  for  explaining 
deviations  of  planning  goals.  The  list  will 
be  preprinted  on  the  worksheets  but  will 
not  be  all  Inclusive.  Federal  Representatives 
may  be  aware  of  other  factors  unique  to  the 
region  or  sponsor.  In  any  event.  It  will  be  In¬ 
cumbent  upon  the  Federal  Representative 
(working  with  the  prime  sponsors)  to  docu¬ 
ment  the  absence  (h  presence  of  Influential 
factors.  Important  factors  In  the  interpre¬ 
tive  description  lists  that  can  be  very  useful 
In  explaining  planned  perfimmance  are  those 
dealing  with  program  mix,  enrollee  character¬ 
istics,  pre-CETA  and  post-CErTA  wages  and 
the  local  unemplo3rment  rate.  These  are 
classed  as  interpretive  factors  and  are  listed 
on  a  sepiuate  worksheet  of  the  review  guide¬ 
line  package.  This  worksheet  will  be  discussed 
in  Srotion  II  of  this  Attachment. 

C.  The  bottom  right  hand  side  of  the  work¬ 
sheets  provides  space  for  explanation  of 
planned  performance.  In  general,  explana¬ 
tion  of  planned  performance  may  not  be 
required  under  the  following  circumstances: 

1.  Planned  performance  which  is  close  to 
the  median. 

2.  Planned  performance  falling  above  the 
median  for  Indicators  In  the  “termination 
cluster”  and  below  the  median  for  Indi¬ 
cators  In  the  "cost  cluster,”  and  for  the  ad¬ 
ministrative  cost  rate  in  the  “fund  utili¬ 
zation  cluster,"  unless  planning  goals  are 
unrealistic  or  serious  programmatic  prob¬ 
lems  are  evident. 

3.  Prime  sponsor  planning  goals  deviating 
significantly  from  the  median,  but  a  reason¬ 
able  improvement  over  recent  previous  per¬ 
formance  Is  planned.  A  prime  sponsor  per¬ 
forming  above  the  median  for  the  termina¬ 
tion  cluster  and  below  It  for  the  others 
should  not  be  permitted  “slippage”  unless 
there  has  been  a  drastic  change  in  local  con¬ 
ditions.  In  fact,  such  sponsors  may  be  ex¬ 
pected  to  Improve  on  their  performance. 

Significant  deviations  from  the  median 
where  an  explanation  may  be  required: 

The  review  process  Is  designed  to  examine 
closely  planned  performance  below  the  flrst 
quartlle  or  above  the  third  quartlle,  depend¬ 
ing  on  the  indicator  or  cluster  being  re¬ 
viewed.  RA’s  should  not  require  written  ex¬ 
planation  of  prime  sponsor  planning  goals 
deviating  from  the  regional  median  to  and 
including  the  flrst  quartlle  for  Indicators 
In  the  “termination  cluster,”  and  the  carry¬ 
out  rate  In  the  “fund  utilization  cluster,” 
and  from  the  regional  median  to  and  Includ¬ 
ing  the  third  quartlle  for  Indicators  In  the 
“cost  cluster”  and  the  “fund  utilization 
cluster.”  RAs  may  request  an  explanation  of 
planned  performance  within  the  limits  out¬ 
lined  above  when.  In  the  opinion  of  the  re¬ 
viewer,  the  planning  goals  are  unrealistic 
or  serious  programmatic  problems  are  evi¬ 
dent.  This  may  include  planned  perform¬ 


ance  which  differs  substantially  from  pre¬ 
vious  performance  without  a  significant 
change  occurring  In  program  operations,  or 
planned  performance  which  may  not  be 
achieved  because  of  serious  administrative, 
managerial  or  fiscal  problems.  The  RA  ihay 
determine  appropriate  situations  and  the 
amount  of  detail  required  for  any  explana¬ 
tion. 

Significant  deviations  from  the  median 
where  an  explanation  is  mandatory: 

An  explanation  of  planning  goals  falling 
below  the  flrst  quartlle  (Q,)  for  indicators 
In  the  “termination  clust^”  and  above  the 
third  quartlle  (Q,)  for  IndlcaUNS  In  the 
“fund  utilization  cluster”  and  “cost  cluster," 
Is  mandatory.  If  these  deviations  occur,  an 
explanation/Justiflcatlon  should  be  as  com¬ 
plete  and  detailed  as  possible. 

Significant  deviations  from  the  median  tor 
which  an  explanation  may  be  required  or  Is 
mandatory,  should  be  explained  by  the  ab¬ 
sence  or  presence  of  Interpretive  environ¬ 
mental  and  iHogrammatic  factors  which  may 
Influence  perfcHrmance  from  the  median. 
These  factors  will  be  pre-prlnted  under  the 
heading  of  Interpretive  descriptions  on  the 
left  hand  side  of  the  perfcKmance  cluster 
worksheets  and  on  a  separate  Interpretive 
factor  worksheet  described  In  this  attach¬ 
ment.  Any  explanation  provided  should  be 
documented  by  appropriate  backup  in  the 
annual  plan  and  by  Information  available 
from  sources  outside  the  plan. 

n.  Interpretive  Factors.  An  additional 
worksheet,  assisting  Federal  Representatives 
In  displaying  performance  In  terms  of  various 
Interpretive  factors.  Is  contained  In  the  work¬ 
sheet  package.  Tliese  factors  should  be  used 
In  conluncUon  with  other  influential  fac¬ 
tors,  which  are  listed  In  the  Interpretive 
description  section  of  the  indicator  cluster 
worksheets  explidnlng  prime  sponsor  per¬ 
formance.  The  interpretive  factors  Include 
categories  of  program  mix,  selected  enrollee 
characteristics,  pre-CETA  and  post-CETA 
wages  and  local  unemployment  rates.  The 
right  hand  side  of  the  worksheet  contains 
a  short  description  on  the  use  of  each  sec¬ 
tion  of  the  Interpretive  factors  which  should 
assist  the  Federal  Representative.  The  left 
hand  side  of  the  worksheet  contains  pre¬ 
printed  total  national  and  regional  experi¬ 
ence  based  on  FT  1976  and  the  transition 
quarter.  Prime  sponsor  data  to  be  cmnpared 
with  the  preprinted  regional  and  national 
totals  explaining  performance  should  be 
filled  In  by  the  Federal  Representative  in  the 
“sponsm*”  column  as  follows: 

A.  Program  Mix. 

1.  Percent  of  Expenditures  by  Program  Ac¬ 
tivity.  Data  for  these  Interpretive  factors  will 
be  obtained  from  Section  F.  of  the  BIS  of 
the  FT  1978  annual  plan.  Cumulative  fourth 
quarter  expenditure  data  for  each  activity 
from  F12.a.  through  F.2.f.  should  be  divided 
by  cumulative  fourth  quarter  total  projected 
expenditures  by  program,  F.2.  The  result 
should  be  multiplied  by  100  and  placed  In 
the  “sponsor”  column  beside  the  appropriate 
activity. 

2.  Percent  of  Cumulative  Enrollment  by 
Program  Activity.  Data  for  these  Interpretive 
factors  will  be  obtained  from  Section  II  of  the 
PPS  of  the  FT  1978  annual  plan.  Cumulative 
fourth  quarter  total  enrollments  (a)  for 
each  activity  from  n.A.  through  n.E.  should 
be  added.  Cumulative  total  enrollments  (a) 
through  the  fourth  quarter  for  each  activity 
should  be  divided  by  the  total  cbtalned  for 
all  activities.  The  results  should  be  multi¬ 
plied  by  100  and  placed  in  the  “sponsor”  col- 
iimn  beside  the  activity.  Since  “other  ac¬ 
tivities”  Is  now  receiving  special  considera¬ 
tion,  an  entry  need  not  be  made  on  the  In¬ 
terpretive  factors  worksheet.  However,  If 
“other  activities”  Is  useful  in  explaining  per¬ 
formance,  this  should  be  considered  in  the 
analysis. 
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B.  Selected  Enrollee  Characteristics.  Data 
for  selected  enrollee  characteristics  will  be 
based  on  the  QSPC  for  FT  1976,  including 
the  transition  quarter.  Since  all  of  the 
planned  enrollee  characteristics  needed  are 
not  available  in  FT  1978  annual  plans,  com* 
parable  actual  data  tar  the  previous  full 
year  will  be  used.  The  assumption  is  that  the 
characteristics  will  be  similar  to  the  spon¬ 
sor’s  FT  1978  program.  The  proportions  of 
selected  characteristics  for  prime  sponsors 
should  be  obtained  from  the  final  report  of 
the  September  1976  RAS/QSPC  dated  Decem¬ 
ber  10,  1976.  This  report  is  available  in  the 
regions. 

C.  Pre-CETA  and  PosUCETA  Median  Wage. 
Data  for  the  pre-CVTA  and  poet>CBTA  me¬ 
dian  wage  will  also  be  based  on  the  QSPC 
for  FT  1876,  including  the  transition  quarter. 
Since  wages  are  not  available  in  the  FT  1978 
planning  data,  comparable  actual  data,  will 
be  used.  The  median  wages  should  be  ob¬ 
tained  from  the  final  report  of  the  Septem¬ 
ber  1976  RAS/QSPC  dated  December  10,  1976. 
This  report  Is  available  In  the  regions. 

O.  Unemplojfment  Rates.  Unemployment 
rate  data  will  not  be  Included  in  the  in¬ 
terpretive  factors  worksheet,  except  for  a 
short  description  m  their  use.  However,  the 
region  should  arrange  to  obtain  local,  re¬ 
gional  and  national  imemployment  rates 
frt»n  sources  within  the  KTA  regional  office 
or  from  the  regional  office  of  the  Bureau  of 
Labor  Statistics.  These  rates  should  be  com¬ 
pared  with  tmemployment  rates  at  recant  pe¬ 
riods  noting  trends  that  may  assist  in  ex¬ 
plaining  deviations. 
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III.  Also  included  is  s  chart  «fhich  provides  for  the  display  of  netionel  and  regional  reference  points  and  priine  sponsor 
planning  goals.  Eaasq>les  of  how  to  ooeplete  the  chert  ere  provided  below  and  the  Federal  Representative  aey  display 
the  required  data  for  each  indicator  sinilarly.  This  display  is  optional  and  siay  be  helpful  to  the  region  and 
priM  sponsor  to  see  relationships  snre  clearly. 


TRIHC  SPONSOR 


FCOERAh  REPRESEtITATIVC 


DATE  REVIEWED 
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FEDERAL  PDPRESENTATIVE 


Termination  Cluster  Formula  Result 

COMPARATIVE  DATA  j 

Region  I 

National 

Total  Positive  as  a  %  of  PPS  I.B.l.  ^  I.B.2.  ..  ,  n*^ 

Total  Terminations  PPS  1.0. 

IT 

-Ml 

0i 

H 

^3 

JU 

H 

-M. 

21 

59 

70 

03 

-Zfl. 

Entered  Eisuloyment  as  a  PPS  I.B.l.  ^  mn 

\  of  Total  Terminations  PPS  I.B. 

14 

26 

36 

46 

2 

22 

32 

43 

87 

Non-Diract  placements  as  PPS  1.^.1. b.  ♦  Y.B.I.c.  « 

a  t  of  Total  Terminations  .  PPS  I.B. 

_ 8 

20 

•  Ji 

40 

-ii 

2 

17 

23 

33 

jii 

Entered  EmDlovment  as  a  P(^{^  I.B.l.  iaa 

t  of  Total  poiitiv.  w-a  i:ii;i.~rT.'r:7r  * 

28 

-Si 

?o 

3 

JlL 

laii 

Non-Darect  as  a  %  PP^  X.B.l.b.  4-  f.B.l.c.  „  i^n 

Entered  Employstent  PPS  I.B.l. 

20 

67 

82 

99 

100 

5 

63 

86 

97 

100 

INTERPRETIVE  DESCRIPTION:  See  interpretive  factors 
contained  in  worksheets 


EXPLANATION/JUSTiriCATlONj 


TERMINATION  CLUSTER 


I^wcr  total  positive  termination  rates  (or  high  non-positive  tate8)| 
may  be  due  to: 

1.  High  enrollment  of  hard-to-place  groupsi 


2.  High  local  uncmployiuent  rates; 


3.  Inadequacies  in  program  operation  (e.g.,  assessment* 
counselling*  job  development)  or  in  program  design 
(e.g.*  long  "holding”  periods  before  placement*  poor 
coordination  between  components*  classifying 
applicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.). 

lx>wcr  entered  employment  rates:  any  of  the  above  plus 
local  emphases  on  "employability  development"  activities 
(e.g.,  high  school  equivalency;  youth  wor)i  ex)>ericncc* 
etc.)  or  intertitle  transfers  leading  to  other  positi^ 
"terminations." 

Lower  nondircct-employment  rates:  j  any  of  the  above  plus 
inclusion  oF <iirect  50b  lolerrar  activities. 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA 


Fund  Utilization  Cluster 

Formula 

Result 

Region  1  | 

1  National 

Carryout: 

%  of  Available  Funds 

DIS  F.2 

100%  -  01S  ETTTfT  * 

3 

8 

H 

11 

Q3 

14 

11 

34 

L 

0 

Qi 

8 

M 

13 

O3 

21 

Administrative  Cost  Rate 

PIS  E. l.d.  _ 

DIS  l.I.A.  *  1“® 

10 

15 

17 

19 

25 

3| 

12 

16 

19 

INTERPRETIVE  DESCRIPTION:  See  Interpretive  factors  contained  EXPLANATION/JUSTIFICATION: 

in  worksheets _ 


FUND  UTILIZATION  CLUSTER 

CARRY  OUT  RATE;  May  be  increased  by; 

.  Start  up  of  new  activities; 

.  Supplemental  appropriations  received  late  in  fiscal  year; 
Internal  administrative*  management*  processing  or 
contracting  problems; 

.  Unplanned  for  events*  since  original  grant  approvals. 
ADMINISTRATIVE  COST  RATE;  May  be  increased  fay; 

.  High  local  cost  structure,  especially  salaries,  rent; 

.  Stress  on  activities  rc^quiring  proportionally  more 
administration  (e.g.*  classroom  training  vs.  work 
experience) j 

.  Stress  on  non-stipended  activities  (e.g.*  services); 

.  ileavy  reliance  on  contractors*  subgrants; 

.  Unplanned  carry  out  of  non-administrative  costs; 

.  Heavy  use  of  computers  or  other  hardware; 

.  High  indirect  cost  rates. 
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PRIHC  SPONSOR; 


FBDCRKL  REPRCSCIITATIVE; 


Comparative  Data 


Cost  Cluster 

Formula 

Results 

Region  1 

National 

Cost  per  positive  termination 

BIS  F.2. 

L 

1132 

1925 

N 

24S3 

W3 

3598 

- 

575t 

~T 

355 

Ql 

1269 

H 

1888 

2606 

tl 

8598 

65,70! 

PPS  l.B.l.  .  I.B.2. 

Cost  per  entered  employment 

BIS  P.2. 

1353 

339B 

4324 

6150 

1506< 

40S 

2857 

4254 

6586 

PPS  l.B.l. 

Cost  per  non-direct  placcsient 

BIS  F.2. 

2sas 

3894 

6144 

7928 

2385! 

'  663 

3693 

S628 

8235 

65,70! 

PPS  I.B.l.b.  .  l.B.l.c. 

INTERPRETIVE  DESCRIPTIONS  See  interpretive  factors  contained  I  EXPLANATION/JUSTIFICATlONs 
in  worksheets _  I 


COST  CLUSTER 

Higher  costs  per  positive  outcome  may  be  due  to  any  of  the 
factors  leadi^  to  lowered  |>ositive  termination  rates,  (see 
termination  cluster  t^rksheet)  plus: 

1.  Ki9h  local  cost  structures  for  standard  items 
(e.9.,  wage  rates,  rental  costs) 1 

2.  Use  of  more  costly  resources  (e.9.,  proprietary 
scliools,  computers,  special  nquipaient); 

3.  Imphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development; 

4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

5.  Stress  on  lunger  term  training  for  higher  skill* 
jobs. 

Highci  Costs  Per  Entered  Employment  suiy  be  due  to  any  of  the 
factors  contributing  to  higner  positive  outcome  costs 
indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet). 

Higher  Costs  Per  Wondircct  Placement  may  be  due  to  any 
of  the  factors  contributing  to  higher  positive  outcoM 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 


PP.IHC  SPONSOR;  _ 

INTERPRETIVE  FACTORS 


FEDERAL  REPRESENTATIVE 


FY  1976  (9/76) 
Actual  Data 


USE  OF  INTERPRETIVE  FACTORS 


t  A.  Program  Mix 


Sponsor* 


National 


PROGRAM  MIX 


1 .  Percent  of  Expenditures 

Classroom  _ 

On-job  training 
Public  Service  Fjaployment 
Work  Experience 
Services 

Other  Activities  _ 

loot 


2.  Percent  of  Cumulative 
Enrol Iments _ 


Classroom  -  prime  sponsor  _ 

Classroom  -  Voc.  Educ.  _ 

On-job  training 

Public  Service  Employstent  _ 

Work  Experience  _ 

Other  Activities  - 

1001 


24 

S 

7 


TOTT 


24 


TotiT 


D.  Enrol lee  Characteristics 


1.  Expenditures:  A  high  proportion  of  total  funds 
in  classroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per."  A  high 
proportion  in  work  experience  may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per." 

2.  Enrollees:  A  high  percentages  of  enrollees  in 
classroom  and  OJT  should  raise  expected 
entered  employment  and  nondlrcct  placement 
rates;  a  high  percent  of  enrollees  in  work 
experience  may  lower  entered  employment  rates 
but  should  raise  expected  other  positive 
termination  rates. 

ENROLLEE  CHARACTERISTICS:  Higher  proportions  of 
youth,  minorities,  high~ school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  place,  and  may  lead  to  longer  term 
or  higher  cost  activities,  and  may  tesult  in  lower 
positive  termination  rates. 


Youth:  18  fc  under 

19  21 

Education:  6  fc  under 
9-11 

Minority:  Black 

Span! sh-Amcr lean 

Handicapped 
Full-time  studcMit 
Offender 


C.  Median  Wage 

1.  Fost-CETA 

2.  Fre-CETA 


$ 

T 


I  3  0B 

5  2.7g 


sz.se 

fTSr 


C.  xPOST-CETA,  WACn  LEVELS;  High  post-CETA  wages,  ond 

wage  rncreas%  relative  to  pre-CETA  wages  may 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  jobs,  high  increases 
may  also  Indicate  a  high  proportion  of  participants 
without  prior  work  experience. 

D.  IXXTAL  UNEMPLOYMENT  RATES:  Also  to  be  considered, 
but  not  sl^wn  in  the  interpretive  indicator  table 
are  local  unemployment  rates.  High  locaP 
unemployment  rates  may  cause  more  difficulty  in 
obtaining  placements,  and  may  influence  sponsors' 
choice  of  activities  and  characteristics  of  enrollem 
(less  disadvantaged). 


^Column  to  be  filled  in  by  Federal  Representative,  ^ee  instructions  contained  in  Attaclusent  1,  Section  11. 
**  Less  than  O.S% 
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COST  CL’-.  aTER  I  FUND  CTIL.  CLUSTER  TER:!::1AT10N  CLVSTT^ 


NOTICES 


REGION **  I* 

CONPAAISON  OF  PRIME  SPONSOR  FY  1970  PLANNING  GOALS  WITH  REGIONAL  AND 
NATIONAL  PERFORHANCE  UASCD  ON  FY  1976  (9/76)  DATA  FOR  ALL  INDICATORS 


TOTAL  POSITIVE  I4AT, 
TERMINATION  P.S. 

RATE  REG. 


TOTAL  ENTERED 
EMPLOYMENT 
RATE 


TOTAL  NONDIRECT  NAT. 


PLACEMENT 

RATE 


ENTERED 

KMPLOYNENT  PER 
POSITIVE 


NONDIRECT  PER 


CAHRY-OOT 

RATE 


ADMINISTRATIVE 

COST 

RATE 

PRIME  SPONSOR! 


FEDERAL  REPRESENTATIVE.: 


COST  CLUSTER  CONTINUED 
ON  NEXT  PAGE 


COST  PER 
POSITIVE 
TERMINATION 

COST  PER 
ENTERED 
EKPU)YHENT 


COST  PER 
NONDIRECT 
PLACEMENT 


REGION  I  (CONTINUED) 

COMPARISON  OF  PniME  SPONSOR  FV  1978  PLANNING  GOALS  WITH  REGIONAL  AND 
NATIONAL  PEIU’OHflANCE  UASEU  ON  FY  197®  (9/76)  DATA  FOR  ALL  INDICATORS 


*  This  chart  used  to  plot  medians,  other  reference  points  and 
prime  sponsor  planning  goals  for  indicators  in  the  termination, 
fund  utilization  and  cost  cluster  is  the  same  for  all  regions. 
Therefore,  the  chart  will  only  be  included  in  the  worksheets 
for  Region  I  for  purposes  of  publication  in  the  Federal  Register. 


PRIME  SPONSOR! 


FEDERAL  REPRESENTATIVE! 


I 
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NOTICES 


PERrORWVNCE  GUIDELIHES  WORKSHEETS-  REGION  II 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  REVIEWED 


PRIME  SPONSOR  FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA 


Termination  Cluster  Formula  Result 

Re9ion  11 

National 

Total  Positive  as  a  %  of  PPS  I.B.l.  *  I.B.2.  .. 

Total  Terminations  PPS  I.B. 

33 

59 

w 

67 

77 

96 

21 

69 

70 

W3 

78 

9i 

Entered  Employment  as  a  PPS  I.B.l.  .  mn 

%  of  Total  Terminations  PPS  I.B. 

6 

23 

34 

46 

84 

2 

22 

32 

43 

87 

Non>Dxrect  Placemienta  as  PPS’l.B.l.b.  ♦  l.D.l.c.  ^ 

a  %  of  Total  Terminations  PPS  I.B. 

4 

16 

33 

66 

2 

17 

23 

33 

Enteced  Employment  as  a  PPS  I.B.l.  _  tn/t 

%  of  Total  Positive  PPS  I.B.l.  ♦  I.B. 2. 

B 

38 

66 

71 

95 

3 

34 

51 

66 

locj 

Non-Direct  as  a  %  of  PPS  l.D.l.b.  *  l.D.l.c.  ^ 

Entered  Employa>ent  PPS  I.B.l. 

5 

61 

72 

91 

100 

6 

63 

86 

97 

loq 

INTERPRETIVE  DESCRIPTION:  See  interpretive  factors 
contained  in  worksheets 


EXPLANATION/ JUSTIFICATION: 


TERMINATION  CLUSTER 

Lower  total  positive  termination  rates  (or  high  non~positive  rates] 
laay  be  due  to: 

1.  High  enrollment  of  hard-to-place  groups; 


2.  High  local  unemployoient  rates; 


Inadequacies  in  program  operation  (e.g.,  assessment, 
counselling,  job  development)  or  in  program  design 
(c.g.,  long  "holding”  periods  before  placement,  poor 
coordination  between  components,  classifying 
applicants  as  participants  prior  to  actual  enrollment 
*  in  program  activities,  etc.). 

Lower  entered  employment  rates;  any  of  the  above  plus 
local  emphases  on  ^employability  development*  activities 
(e.g.,  high  scliool  equivalency;  youth  \tozk  experience, 
etc.)  or  intertitle  transfers  leading  to  other  positive 
"terminations.* 

Lower  wndirect-employment  rates;  any  of  the  above  plus 
inclusion  of  direct  job  referral  activities, 


FEDERAL  REGISTER,  VOL  42,  NO.  166 — FRIDAY,  AUGUST  26,  1977 


NOTICES 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


Fund  Utilitation  Cluatar 


PoriMala 


Result 


Cacryoutt 

%  of  Available  Funde 


Administrative  Cost  Rate 


INTERPRETIVE  DESCRIPTION!  See  interpretive  factors 


contained 


in  worksheets 


FUND  UTILISATION  CLUSTER 


CARRY  OUT  RATE I  May  be  increased  by; 


.  Start  up  of  new  activities; 

•  Supplemental  appropriations  received  late  in  fiscal  year; 
.  Internal  administrative,  management,  processing  or 

contracting  problemsi 

•  Unplanned  for  events,  since  original  grant  approvals. 
ADMINISTRATIVE  COST  RATE!  May  be  increased  by* 

.  High  local  cost  structure,  especially  salaries,  rent; 

•  Stress  on  activities  requiring  proportionally  more 
administration  (e.g.,  classroom  training  vs.  work 
experience) i 

•  Stress  on  nod-stipended  activities  (e.g.,  services); 

•  Heavy  reliance  on  contractors,  aubgrants; 

•  Unplanned  carry  out  of  non- administrative  costs; 

.  Heavy  use  of  computers  or  other  hardware; 

.  High  indirect  cost  rates. 


FEDERAL  REpaESCNTATIVEl 


PRIME  SPONSOR! 


Comparative  Data 


National 


Reg ion  1 1 


Results 


Formula 


Cost  per  positive  termination 


1269 


4254 


6586 


Cost  per  entered  employment 


Cost  per  non-direct  placement 


INTERPRETIVE  DESCRIPTION:  See  interpretive  factors  contained 
in  worksheets _ 


COST  CLUSTER 


Higher  costs  per  positive  outc^e  may  be  due  to  any  of  the 
factors  leading  to  lowercd'^sltive  termination  rates,  (see 
termination  cluster  worksheet)  plus; 

1.  High  local  cost  structures  for  standard  items 
(e.g.,  wage  rates,  rental  costs); 

2.  Use  of  more  costly  resources  (e.g.,  proprietary 
sclK>ol8,  computers,  special  equipment); 

1.  Emphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development; 

.  4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

5.  Stress  on  .longer  term  training  for  higher  skill’ 
iobs. 

Higher  Costs  Per  Entered  Employment  may  be  due  to  any  of  the 
factors  contributing  to  Signer  positive  outcome  costs 
Indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet) . 

Higher  Costs  Per  Nondirect  Places>ent  may  bo  due  to  any 
of  the  factors  contributing  to  higher  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 


FEDERAL  REGISTER,  VOL.  42.  NO.  166— FRIDAY,  AUGUST  26,  1977 


COMPARATIVE 

DATA 

Region  11 

National 

!•  0i  M  oj 

H 

L 

0i 

M  O3 

H 

0  5  9  H 

36 

0 

8 

13  21 

53 

9  13  16  19 

26 

3 

12 

16  19 

37 
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NOTICES 


PRIME  SPONSOR: 


PCDCRM.  REPRESENTATIVE 


INTERPRETIVE  PACTOHS 
Program  Mix 

1 .  Percent  of  Expenditure* 

Classroom 
Oii'-^ob  training 
Public  Service  Employment 
Mork  Experience 
Services  ^ 

Otlier  Activities 


Classroom  -  prime  sponsor 
Classroom  -  Voc.  Educ. 
On-job  training 
Public  Service  Employment 
Work  Experience 
Other  Activities 


E^nrolloc  Characteristics 

1.  Youth:  18  under 

19  -  21 

2.  Education:  6  fc  under 

9-11 

3.  Minority:  Black 

Spanish-Awerican 

4.  Handicapped 

5.  Full-time  student 

6.  Offender 


FY  1976  (9/76) 
Actual  Data 


USE  OF  INTERPRETIVE  PACTORS 


Sponsor* 


Wsgton  11  National  a.  PROGRAM  HIX 


— r“ 

l&Ot 


r7~ 

Ifioi 


— r“ 

TBUr 


C.  Median  Wage 


1. 


$2.98 

fTTTff" 


$2.88 

HTn: 


1.  Expenditures:  A  high  proportion  of  total  funds 
in  classroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per."  A  high 
proportion  in  work  experience  may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per." 

2.  Enrollees:  A  high  percentages  of  enrolloes  in 
cTa^sroom  and  OJT  should  ra^se  expected 
entered  employment  and  nondlrect  placement 
rates;  a  high  percent  of  enrollees  in  work 
experience  may  lowef  entered  employment  rates 
but  should  raise  expected  other  positive 

^  termination  rates. 

ENROLLEE  CHAWiCTERlSTlCS:  Higher  proportions  of 
you^iV  minorities,  high  school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  place,  and  may  leod  to  longer  term 
or  higher  cost  activities,  and  may  result  in  lower 
positive  termination  rates. 

'POST-CETA,'  WAGE  ^VELS:  High  post-CETA  wages,  and 
wage  increase  relative  to  pre-CCTA  wages  may 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  jobs,  high  increases 
may  also  indicate  a  high  proportion  of  participants 
without  prior  work  experience, 

LOCAL  UNEMPLOYMENT  RATES:  Also  to  be  considered, 
but  not  showi^rn  the  ihierpretive  indicator  table 
are  local  unemployment  rates.  High  local 
unemployment  rates  may  cause  store  difficulty  in 
obtaining  placements,  and  may  influence  sponsors' 
choice  of  activities  and  characteristics  of  enrolles 
(less  disadvantaged). 


to  be  filled  in  by  Federal  Representative.  See  instructions  contained  in  Attaclunent  1,  Section  II. 


PERF0RMAT4CC  GUIDELINES  WORKSHEETS-  REGION  HI 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  REVIEWED 


FEDERAL  REGISTER,  VOL.  42,  NO.  166— FRIDAY,  AUGUST  26,  1977 


NOTICES 


PRIME  SPONSOR 


FEDERAL  RBrRBSENTATIVC 


Termination  Cluster  Formula  Result 

COMPARATIVE  DATA  | 

Region  111 

National 

Total  Positive  as  a  %  of  PPS  I.D.l.  *  I.B.2. 

Total  Terminations  PPS  I.B. 

43 

Qi 

62 

72 

79 

^TT 

93 

^1 

H 

Lja. 

03 

pZi 

L_ai 

Entered  Employment  as  a  PP^  It.B.l.  ^  iaa 

%  of  Total  Terminations  PPS  1.0. 

2 

19 

26 

33 

68 

2 

22 

32 

43 

8' 

Non-Dirset  Placements  as  PPS  I.B.l.h.  I.D.l. c.  ..  iaa 

a  %  of  Total  Terminations  PPS  I.^. 

2 

.  18 

21 

29 

57 

_ 2 

17 

23 

33 

_7; 

Enlerod  KwloviMnt  a.  a  PPS  I.B.l.  _ 

»  of  Tot.i  positiv.  pps  i.6;i:”"r:i5;i7  * 

i 

2« 

3? 

55 

88 

3 

34 

51 

66 

101 

Uon-6irect  as  a  %  of  PPS  1.0. l.b.  *  I.f^.T.c.  .  ^aa 

Entered  Cmployioent  PPS  I.B.l. 

24 

76 

95 

99 

100 

_ 5 

63 

86 

97 

INTERPRETIVE  DESCRIPTION:  Sec  interpretive  factors 
contained  in  worksheets 


EXPLANATION/ JUSTIfICATlONi 


TERMINATION  CLUSTER 


Lower  total  poeitive  teriaination  rates  lor  high  non-positive  rates: 
laay  be  due  toi  ^ 

1.  High  enrollment  of  hard-to-placc  groups} 


2.  high  locdl  unc-n.pluyment  ratesf 


3.  Inadequacies  in  program  operation  le.g.,  assessment, 
counsslling,  job  development)  or  in  program  design 
(e«g«,  long  "holding*  periods  before  placement,  poor 
coordination  between  coaiponenta,  claaaifying 
applicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.). 

Lower  entered  employment  rates:  any  of  the  above  plus 
local  emphases  on  ^employability  devalopmeJH*  activities 
(e.g.,  high  school  equivalency}  youth  «m>i)i  experience, 
etc.)  or  intertitle  transfers  leading  to  otlier  positive 
*  terminations • * 

Lower  fiondlrect-emnlovmcnt  rates:  any  of  tha  above  plus 
liMlusion  ok  direct  referral  Mtivitles, 


PRIMS  SPONSOR 


FEDERAL  REPRESENTATXVB 


COnPARATIVC  DATA  1 

Fund  Utilisation  Cluster 

Formula 

•••ult 

•agio.  Ill 

National 

Carryout: 

%  of  Available  Funds 

10.6  -  iij  »  100 

0 

'W 

7 

TT* 

11 

03 

17 

u 

35 

L 

0 

0i 

t 

H 

13 

03 

21 

H 

53 

Mainistiatl*.  Cost  Rat. 

•if  ■|^Ht » 

3 

10 

12 

17 

29 

3 

12 

16 

19 

37 

INTERPRETIVE  DESCRIPTION:  See  interpretive  factors  contained 
in  worksi^ets 

FUND  UTIHIATION  CLOSTER 


EXPLANATION/JUSTXPICATIOH I 


CARRY  OUT  RATE:  May  be  increased  byi 

•  Start  up  of  new  activities} 

•  Supplemental  appropriations  rscsivod  lats  in  fiscal  year} 
.  Internal  administrative,  management,  processing  or 

contracting  problems} 

.  Unplanned  for  events,  since  original  grant  approvals. 
ADMINISTRATIVE  COST  RATE:  May  be  increased  byi 

.  Nigh  local  cost  structurs,  especially  salaries,  rent} 

•  Strsss  on  ectivitiss  requiring  proportionally  more 
administration  (s.g.,  classroom  training  vs.  wor)c 
expsrience) i 

•  Stress  on  non-stipended  activities  (e.g.,  services)} 

.  Heavy  reliance  on  c<N:tractors,  subgrantsi 

.  Unplanned  carry  out  of  non-administrative  coats} 

.  Heavy  uas  of  coaputers  or  other  hardware; 

.  High  indirect  cost  rates. 


\ 
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43258 


NOTICES 


prihe  SPONSOR: 


FEDERAL  representative t  - 


Comparative  Data 


Region  m 


12S9 


2606 


8598 


Ol 

1587 


03 

2544 


4762  6790  8695  6570 


3693|  5628  |  8235  |S5,70j 


EXPLANATlON/JUSTIFlCATIONi 


Cost  Cluster 


Cost  per  positive  termination 


Cost  per  entered  employment 


Cost  per  noo-direct  place 


BIS  F.2. 

PPS  l.B.T.t.  ♦  I.B.l.C. 


COST  CLUSTER 


Higher  costs  per  positive  outc^e  may  be  due  to  any  of  the 
factors  leading  to  loi^red  positive  termination  rates,  (see 
termination  cluster  morksheet)  plus: 


1.  High  local  cost  structures  for  standard  items 
(e.g.«  wage  rates,  rental  costs); 

2.  Use  of  more  costly  resources  (e.q.,  proprietary 
scliools,  computers,  special  equipment); 

3.  Emphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development; 

4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

5.  Stress  on  longer  term  training  for  higher  skill* 
jobs. 

Higher  Costs  Per  Entered  Fautloyment  may  be  due  to  any  of  the 
f actors  cont r ibut ing  to  higner  pos i t i ve  outcome  costs 
indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet) . 

Higher  Costs  Per  Mondirect  Placement  may  be  due  to  any 
of  the  ^^tors  contributing  to^igher  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 


PRIME  SPONSOR:  _ 

INTERPRETIVE  FACTORS 
A.  Program  Mia 


_  FEDERAL “representative  _ 

FT  1976  (9/76) 

Actual  Data  USE  OF  INTERPRETIVE  FACTORS 


Sponsor*  Region  II i  National  A.  PROGRAM  MIX 


1.  Percent  of  Eapenditures 

Classroom  _ 

On-job  training  _ 

Public  Service  ag>loyment  _ 

Work  Experience  _ 

Services 

Other  Activities 

100% 


2.  Percent  of  Cumulative 
Enrollments _ 


Classroom  -  prime  sponsor  _ 

Classroom  -  Voc.  Educ. 

On-job  training 

Public  Service  Employment 

Work  Experience  _ 

Other  Activities 

~rm- 

B.  Enrollee  Characteristics 


28  30 

6  _ ?_ 

16  11 

41 

10^%  i0o% 


26  24 

- 

~~r~‘  ""“T  • 

100%  nrav 


1.  Expenditures:  A  high  proportion  of  total  funds 
in  classroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per."  A  high 
proportion  in  work  experience  may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per." 

2.  Enrol lees:  A  high  percentages  of  enrollees  in 
cTassroom  and  OJT  should  raise  expected 
entered  employment  and  nondircct  placement 
rates;  a  high  percent  of  enrollees  in  work 
experience  may  lower  entered  employment  rates 
but  should  raise  expected  other  positive 
termination  rates. 

B.  ENROLLEE  CUAWiCTERI S1‘1CS ;  Higher  proportions  of 
youth,  minorities,  high  school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  Utose  most 
difficult  to  place,  and  may  lead  to  longer  term 
or  higher  cost  activities,  and  may  result  in  lower 
positive  termination  rates. 


1.  Youth:  18  fc  under  % 

19  -  21  - 

2.  Education:  8  s  under 

9-11 

3.  Minority:  Black 

Span i sh-Amer i cam 

4.  Handicapped 

5.  Full-time  student  " 

6.  Offender 


C.  Median  _Hia£ 

1.  Post-CETA  $ 

2.  Pre-CETA 


$2.86 

nns; 


*7r~ 

~rrr 


a.ee 

fc.67 


C.  -  POST-CETA,  WAGE  LEVELS;  High  post-CETA  wages,  and 

wage  increase  relative  to  pre-CETA  wages  may 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  jobs,  high  increases 
may  also  indicate  a  high  proportion  of  participants 
without  prior  work  experience. 

D.  LOCAL  UNEMPLOYtlENT  RATES:  Also  to  be  considered, 
but  'iH^  shown  in  the  interpretive  indicator  table 
are  local  unemployment  rates.  High  local 
unemployment  rates  may  cause  more  difficulty  in 
obtaining  placements,  and  may  influence  sponsors' 
choice  of  activities  and  characteristics  of  enrollem 
(less  disadvantaged). 


‘Coluw  to  be  filled  in  by  Federal  Representative.  See  inatructlons  contained  in  Attachment  1,  Section  II. 
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PERFOi^MAWCE  GUIDELINES  WORKSHEETS-  REGION  IV 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  RI^IEWED 


PRIME  SPONSOR 


FEDERAL  P.EPRCSENTATIVB 


COMPARATIVE  DATA 


Region  IV 


National 


Terailitation  Cluster 


Pornul; 


Result 


itions 


Entered  Employment  as  a 


linations 


Noii-Direct  Placeiae'nLs  as 


a  t  of  Total  Terminations 


Entered  Employment  as 
'  ot  Total  Positls/e 


Entered  Employment 


INTERPRETIVE  DESCRIPTIONt  See  Interpretive  factor; 
contained  in  worksheets 


EXP^ANATION/JUSTIFICATIONi 


TERMINATION  CLUSTER 


rates  (or  high  nonopositive  rates)! 


Lower  total 
may  be  due  toi 

1.  High  enrollment  of  hard-to-place  groups; 


2.  High  local  unemployment  rates 


inade<}uacies  in  program  operation  (e.g.,  assessment, 
counselling,  )ob  develo^anent)  or  In  program  design 
(e.g.,  long  "holding”  periods  before  plucement,  poor 
coordination  between  components,  classifying 
applicants  as  participants  prior  to  actual  enrollment 
in  piogtaiu  activities,  etc.). 


entered  employment  rates:  any  of  the  above  plus 
emphases  on  ^employability  development”  activities 
high  school  equivalencyr  youth  wor)c  experience, 

>r  intcrtitle  transfers  leading  to  other  positive 


tloymcnt  rates;  any  of 
i>l»  rofcVral  activities. 


Lower  nondircct- ei 
i nr  1  u.s )  1  in  di rect 
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NOTICES 


FEDERAL  REPRESENTATIVE 


Fund  Utilization  Cluster  Formula  **  Resul 

Cacryouti  100%  -  Stq  '  *  1®® 

%  of  Available  Funds  E.7,f. 

“  PIS  E.l.d,  .. 

Xdainistrative  Cost  Rate  BIS  E.7.d.  *  ***'* 

IHTERrHETlVt  DESCRIPTION:  Sec  interpretive  factors  contained 
in  »#orksheet8  _ _ 

FUND  irriLItATlON  CLUSTER 

CARRY  cniT  RATE;  May  be  increased  by: 

•  Start  up  of  new  activitiesi 

,  Supplenental  a|>propriations  received  late  in  fiscal  year} 

.  Internal  administrative,  management,  processing  or 
contracting  problems; 

.  Unplanned  for  ev«»ts,  since  original  grant  approvals, 

ADMlMlSTRATIVt:  COST  RATE;  May  be  increased  by: 

,  lligli  local  cost  structure,  especially  salaries,  rent; 

,  Stiess  on  activities  requiring  proportionally  more 
administration  (e.g.,  classroom  training  vs.  %#ork 
experience) ; 

,  Stress  on  noo-stipended  activities  (e.g.,  services)! 

•  Heavy*  reliance  on  contractors,  subgrantsi 

,  Unplanned  carry  out  of  non-administrative  costs; 

.  Heavy  use  of  comi>uters  or  other  hardware! 

.  High  indirect  cost  rates. 


COMPARATIVE 

DATA 

Region  IV 

National 

i  0l  "R”  Qj  H 

j  Ql  M  O3  H 

0  7  12  21  42 

0 

1  e  13  21  53 

4  1  11  IS  IB  23 

A 

|l2  16  19  37 

EXPLAN ATIOH/ JUST I F ICAT ION 


FEDERAL  REPKESEIfTATlVE!  • 

I  Comparative  Data 


Cost  per  positive  termination  I  PIS  _ 

I  PPS  I.B.l”  ♦  I.B.3 


Cost  per  entered  eng>loyment 


BIS  F.2. 
PPS  I.D.l. 


372  1112  1587|  2344  6S6i  3SS  j.269|  1688  2606  [  B598 

492  2974  S407|  7692  21869  405  28571  4254  6586  |65,70! 


863143291  7l67i  9632} 21869  863  I  36931  5628  I  8235  ! 

EXPLANATlON/JUSTIFICATIONi 


I 


.  -m 


Higher  costs  per  positive  outc^c  may  be  due  to  any  of  the 
factors  Icadi^  to  lowered  positive  termination  rates,  (see 
termination  cluster  worksheet)  plus: 

1.  High  local  cost  structures  for  standard  items 
(e.g.,  wage  rates,  rental  costs); 

2.  Use  of  more  costly  resources  (e.g.,  proprietary 
scltools,  computers,  special  equipment); 

3.  Emphasis  on  su|jportive  services  (trans|>ortation, 
day  care,  etc.),  classroom  training,  employability 
development; 

>  4.  Higher  than  minimum  rates  for  participant  stipends, 
wages: 

5.  Stress  on  longer  term  training  for  higher  skill' 

3obs. 

Higher  Costs  Per  Entered  L^tloyment  may  be  due  to  any  of  the 
f actors  cun t r i  i  ng  to  higlier  pos  i  1 1  ve  outcoste  costs 
indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet). 

Higher  Costs  Per  Nondirect  PlaceaK?nt  may  be  due  to  any 
of  tlie  factors  contrDMting  to  higher  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 
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INTElirT^ItTIVE  factors 


_ _  FEDERWU  REPRESENTATIVE 

FY  1976  (9/76) 

Actual  Data  USE  OP  INTERPRETIVE  FACTORS 


1.  Percent  of  i:xi>cndj  turea 


Classrooio 

Oil-job  training 

Public  Service  fCmployment 

Work  Experience 

Services 

ocher  Activities  * 


ClasarooiA  -  prime  sponsor 
Classroom  •  Voc.  Educ. 
On-job  training 
Public  Service  Employment 
Work  Experience 
Other  Activities 


B.  Enrol  lee  Characteristics 

1.  Youth:  16  6  under 

19  -  21 

2.  Education:  8  4  under 

9-11 

3.  Minority:  Black 

Span ish-Amer lean 

4 .  Handicapped 

5.  Full-time  student 

6.  Offender 


*Column  to  be  filled  in  by  Federal  Representative, 
**  Less  than  O.S%, 


A.  PROGRAM  MIX 

1.  Expenditures:  A  high  proportion  of  total  funds 
IncTassroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per."  A  high 
proportion  In  work  experience- may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per." 

2*  Enrollees:  A  high  percentages  of  enrollees  in 
classroom  and  OJT  should  raise  expected 
entered  employment  and  nondirect  placement 
rates  I  a  high  percent  of  enrollees  in  work 
experience  may  lower  entered  employment  rates 
but  should  raise  expected  other  positive 
termination  rates. 

B.  ENROLLEE  CHAMiCTERI STICS :  Higher  proportions  of 

ybuthr  Sig^ school  dropouts,  handi¬ 

capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  place,  and  may  lead  to  longer  term 

or  higher  cost  activities,  and  siay  result  in  lower 
positive  termination  rates. 

C.  POST-CETA,  WAGE  LEVELS:  High  post-CETA  wages,  and 
wage  lncreas%  Felat ive  to  pre-CETA  wages  may 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  jobs,  high  increases 
may  also  indicate  a  high  proportion  of  participants 
without  prior  work  experience. 

D.  LOCAL  UNEMPLOYMENT  RATES ;  Also  to  be  considered, 
but  not  shown  In  the  interpretive  indicator  table 
are  local  unemployment  rates.  High  local 
unemploysient  rates  may  cause  more  difficulty  in 
obtaining  placements,  and  may  influence  S(>onsors* 
choice  of  activities  and  characteristics- of  enrollem 
(less  disadvantaged). 


See  instructions  contained  in  Attachment  1,  Section  11. 


PERFORMANCE  GUIDELINES  WORKSHEETS-  REGION  V 


FEDERAL  REPRESENTATIVE 
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NOTICCS 


FEDERAL  PJIPRESEMTATJVE 


PRIME  SPONSOR 


COMPARATIVE  DATA 


Revlon  V 


National 


Result 


fortnula 


Tcrxii uation  Cluster 


Total  TerwiMtions 
EotereS  E«nj!oy«sent  as  a 
%  of  Total  Terainations 
rkMi'Dlrect  PiaceMcats  as 


i'litercil  Csiployaicnt  as 


%  of  Total  Positive 


Entered  fimploynwnt 


INTERPRETIVE  DESCRIPTION; 
contained  in  worksheets 


TERMINATION  CLUSTER 


total  fjQsitive  terwination  rates  (or  high  non^positive  rates 


may  be  due  to; 

1.  High  enrollment  of  hard-to-place  groupsi 


2,  High  local  unemployment  ratesf 


Inadequacies  in  program  operation  (e.g.«  assessment, 
counselling,  job  develufiment)  or  In  program  design 
(e.g.,  long  "holding"  periods  before  placement,  poor 
coordinatioti  between  components,  classifying 
applicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.). 


entered  employment  rates;  any  of  the  al>ove  plus 
smphases  on  "employability  development*  activities 
high  school  equivalency;  youth  work  experience, 

>r  intcrtitle  transfers  leading  to  other  positive 


PRIME  SPONSOR 


FEDERAL  KEPRESENTATIVE 


Fund  Utilisation  Cluster 


Formula 


Carryout: 

%  of  Available  Funds 


Administrative  Cost  Rate 


lNTtRi‘H»:TlVE  DESCRIPTION; 


See  interpretive  factors  contained 
in  worksheets _ 


FUND  UTILIZATIOM  CT.USTER 


CARRY  OUT  HATE 


.  Stact  up  of  new  activities; 

.  Supplemental  appropriations  received  late  in  fiscal  ] 
•  Internal  administrative,  management,  processing  or 
contracting  problems; 

.  Unplanned  for  events,  since  original  grant  approvals. 
AUMINl STRATI VE  COST  HATE;  May  bo  increased  by; 


High  local  cost  structure,  es|>ecially  salaries,  rent; 
Stress  on  activities  requiring  proportionally  more 
administration  (e.g.,  classroom  training  vs.  work 
experience) ; 

Stress  on  non-stipended  activities  (e.g.,  services)! 
Heavy  xdianco  on  contractors,  suLgrants; 
tjnp)amied  carry  out  of  nonoadministrative  costs; 

Heavy  use  of  computers  or  other  hardware; 

High  indirect  cost  rates. 
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COMPARATIVE 

DATA 

1  Region  v 

1 

National 

L 

M 

03 

H  1  L 

Qi 

M  Qj 

H 

0  9 

16 

21 

53  J  0 

a 

13  21 

53 

J  12 

15 

19 

”  I  ^ 

12 

16  19 

37 

'V 


NOTICES 


FEDERAL  REPRESENTATIVE  > 


Ccwparatlve  Data 


Coat  per  positive  taraination  I  t 


Cost  per  antcred  c»ployant  _ _  1125  I  aisj  ma|  79«4|  281 

Cost  per  non-direct  placement  g-  ’--v  -v— t”  ■ 

_  I  PPS  I.&:r:F7  V  I.^71.c7  | _ la^l  <099!  6S14ll0344l2a3 

INTEKPRlilTlve  DESCRIPTION:  See  interpretive  factors  contained  .  EXPLMlATlON/JUSTlPICATlONi 
in  worksheets 


527  1364  2080  2789  g2lJ  35S  1269  1888  aSSg 

1125  3383  4958  7944  28129  405  2857  4254  6586  65, 70S 


Higher  costs  per  positive  outcos>e  may  be  due  to  any  of  the 
factors  leadi^  to  lowered  positive  termination  rates,  (see 
termination  cluster  worksheet)  plus: 

1.  High  local  cost  structures  for  standard  items 
(c.g.,  wage  rates,  rental  costs) i 

2.  Use  of  more  costly  resources  (e.g.,  proprietary 
schools,  computers,  special  equipment); 

3.  Emphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroosi 'training,  employability 
development; 

4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

5.  Stress  on  longer  term  training  for  higher  skill 
jobs. 

Higher  Costs  Per  Entered  Esinloyment  may  be  due  to  any  of  the 
factors  contributing  to  higher  positive  outcome  costs 
indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet). 

Higher  Coats  Per  Hondirect  Placement  may  be  due  to  any 
of  the  factors  contributing  to  higher  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 


IWTEHPHETIVE  FACTORS 


1.  Percent  of  Expenditur 


Classroom 

On*job  training 

Public  Service  Employment 

Work  Experience 

Services 

Other  Activities 


Classroom  -  prime  sponsor 
Classroom  -  Voc.  Educ. 
On-'jpb  training 
Public  Service  Employsient 
Work  Experience 
Other  Activities 


D.  Enrollce  Characteristics 

1.  Youth:  18  &  under 

19-21  . 

2.  Education:  8  4  under 

9-11 

3.  Minority:  Dlack 

Spanish- American 

4.  Handicapped 

5.  Pull-time  student 

6.  Offender 


FEDERAL  REPRESENTATIVE  ^ 

FY  1976  (9/76) 

Actual  Data  USE  OF  INTERPRETIVE  FACTOR 


Region  V  National 


1.  Expenditures:  A  high  proportion  of  total  funds 
Tn  classroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per,"  A  high 
proportion  in  work  experience  may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per." 

2.  Enrol lees:  A  high  percentages  of  enrol lees  in 
classroom  and  OJT  should  raise  expected 
entered  employa»ent  and  nondirect  placement 
rates;  a  high  percent  of  enrollees  in  work 
experience  may  lower  entered  employment  rates 
but  should  raise  expected  other  positive 
termination  rates. 

B.  ENROLLEE  CIIAWiCTERI STICS :  Higher  proportions  of 
youth,  minorities,  high  school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  place,  aiwi  m»y  lead  to  longer  term 

or  higher  cost  activities,  and  may  result  in  lower 
positive  termination  rates. 

C.  vPOST-CETA,  WAGE  LEVELS:  High  post-CETA  wages,  and 

wage  increase^  relative  to  pre-CETA  wages  My 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higiter  skilled  jobs,  high  increases 
may  also  Indicate  a  high  proportion  of  participants 
without  prior  work  experience. 

D.  IXX:aL  UNRMP1X)YMENT  RATES;  Also  to  be  considered, 
but  ru>t  shown  11^ the  interpretive  indicator  table 
are  local  unemployment  rates.  High  local 
unemploynient  rates  may  cause  more  difficulty  in 
obtaining  placements,  and  may  influence  sponsors* 
choice  of  activities  and  characteristics  of  cnrollem 
(less  disadvantaged). 


"Column  to  be  filled  in  by  Federal  Representative.  See  instructions  contained  in  Attachment  1,  Section  II. 
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NOTICES 


^NCC  GUIDfLlNES  WORKSHEETS’  m;GIOW  VI 


pi:dcral  representative 


DATE  REVIEHED  « 


rCDeJUOi  PfPRESBHTATIVE 


COHPARATIVE  DATA 


T«r«iiidtioii  Cluster 

Total  Posttivs  e?  a  %  of 
Total  TmaiAatioftg 
Entered  C^Toyment  as  a 
%  of  Total  Tc’tminations 
tton-Oireet  l^lereifttiir*  Ts  "" 
a  %  of  Total  Teretwat 
Entered  as  a 

%  of  Total  Positive 

HonDir^et  *3  a  %  Of 
Eniecud  EMpicyteent _ 


pps  i.w: 

pps  i.mVi.b.  ^  i.d»T7er“ 

_  PPS  I.N. _ ] 

t.B.l.  , 

PPS  I.B.l.  I.B.iV 

pps  r.ii.i.b.  ♦  ' 

_  FPS  I.P.l. _ 

Sec  interpretive  factors 


69|  7$  21 1  Sf  70  7t 

lol  43  53  6*  2 1  22  32  _<3  r 


2l|  271  34  57 1  2  |  17  23  33  1  7» 


_i7_ 3  34  51  44  lOC 

5S  72  49  100  5  43  84  97  IOC 


EXFiANATION/JUSTlPlCATIONi 


THIWT NATION  CLUSTER 

Uiwer  total  positive  te reinetion  rates  (or  hlvh  non-^positiv 
May  be  due  toi 

1.  Iligli  enrolleent  of  hard-to~'place  9roupsi 


2,  111911  IocaI  uneMployMUDt  rates; 

3t  Inadequacies  in  proqrae  operation  (e.9.«  assesssMnt, 
counselling,  job  develofSMAt)  or  in  progran  desiTn 
(e.g.,  long  *holdlng"  periods  before  placenent,  poor 
coordination  between  coagmnents,  classifying 
applicants  as  participants  prior  ^to  actual  enrollnent 
in  program  activities,  etc.}.  ^ 

Lower  entered  emplOYeent  rates:  any  of  the  above  plus 
local  emphases  on  ^esiployabill^  developnent*  activities 
(e.g.,  high  school  eqeivalencyi  youth  work  experience, 
etc.)  or  intertitle  transfers  leading  to  other  positive 
*  t  c  rn  i  na  1  i  one .  * 

Lower  nondirect»eoplovsient  retest  any  of  the  above  plus 
inclusion  of  direct  jol>  referral  ectlvities. 
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PRIHL  SPONSOR 


PEDERRL  REPRESENTATIVE 


COMPARATIVE  DATA 

Fund  Utilization  Cluster 

Formula 

Result 

Region  VI 

National 

Carryout; 

%  of  Available  Funds 

BIS  F.2 

1®®*  -  Bis  EJT.f.  *  1®® 

0 

9 

11 

©3 

IS 

H 

29 

L 

0 

Qi 

8 

M 

13 

03 

21 

H 

53 

Administrative  Cost  Rate 

BIS  E.l.d.  m 

Bis  *  ‘®® 

4 

12 

IS 

19 

27 

3 

12 

16 

19 

37 

INTERPUETIVE  DESCRIPTIONS  Se«  interpretive  rectors  contained 
in  worksheets 


EXPLANATION/JUSTIFICATION i 


FUND  UTILIZATION  CLUSTER 

CARRY  OUT  RATES  May  be  increased  by:  f 


.  Start  up  of  new  activitiesi 

•  Supplesiental  appropriations  received  late  in  fiscal  year; 
.  Internal  administrative,  management,  processing  or 

contracting  problems} 

.  Unplanned  for  events,  since  original  grant  approvals* 

ADHINISTRATIVE  COST  RATE;  May  be  increased  byi 

.  High  local  cost  structure,  especially  salaries,  rent} 

.  Stress  on  activities  requiring  proportionally  more 
administration  (e.g.,  classroom  training  vs.  work 
experience) $ 

,  Stress  on  non^stipended  activities  (e.g.,  services)} 

•  Heavy  reliance  on  contractors,  subgrantsi 

.  Unplanned  carry  out  ot  non-administrative  costs} 

.  Heavy  use  of  costputers  or  other  hardware} 

.  High  indirect  cost  rates. 


PRIME  SPONSOR; 


FEDERAL  REPRESENTATIVE} 


Comparative  Data 


T — T-gi- 

671  1110 


Oi'T  T 

17S4  356S| 


355 


Uf"rt« - 1  O3  I  « 

1269  1888  2606  I  B598 


65.7051 


EXPLANATION/JUSTIFICATION 1 


Cost  Cluster 


Cost  per  positive  termination 


Cost  per  entered  employment 


Cost  per  non-dlrect  placement 


OIS  F.2. 

PI^S^.B.l.  ♦  I.B.2V 


BIS  F.2. 
PPS  I.B.l. 


DIS  P.2. 

PPS  I. B.i 1 7B.i.c. 


COST  CLUSTER 


Higher  costs  per  positive  outcome  way  be  due  to  any  of  the 
factors  leading  to  lowered  positive  termination  rates,  (see 
termination  cluster  worksheet)  plus; 

1.  High  local  cost  structures  for  standard  items 
(e.g.,  wage  rates,  rental  costs)} 

2.  Use  of  more  costly  resources  (e.g.,  proprietary 
schools,  computers,  special  equipment); 

3.  Emphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development; 

.  4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

S.  Stress  on  longer  term  training  for  higher  skill 1 
jobs. 


Higher  Costs  Per  Entered  Employment  may  be  due  to  any  of  the 
factors  contributing  to  higher  positive  outcome  costs 
indicated  above  plus  those  leading  to  lowered  entered 
ciHployment  rates  (see  termination  cluster  worksheet). 


Higher  Costs  Per  Nondirect  Placement  may  be  due  to  any 
of  the  factors  contributing  to  ^ligKer  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
refer ral  activities. 
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NOTICES 


PRIME  SPONSOR* 

INTEKPRETIVE  FACTORS 


_ _  PCDBRAL  REPRESENTATIVE  -  ■  .  ■ _ 

FY  1976  (9/76) 

Actual  D>f  USE  or  INTERPUrriVE  FACTORS 


ProTram  Mix 

1.  Percent  of  Cxi>cnditurea 

Sponsor* 

Region  VI 

National 

Classroom 

12 

30 

On-job  training 

11 

9 

Public  Service  Employment 

— r“ 

11 

Work  Experience 

«3 

- 15 - 

Services 

8 

B 

Otluir  Activities 

1 

— I — 

2.  Percent  of  Cumulative 
Enrollments 

-n6v~ 

loot  ' 

Classroom  -  prime  sponsor 

23 

24 

Classroom  -  Voc.  Cduc. 

12 

g 

On-job  training 

11 

g 

Public  Service  Employsient 

4 

Work  Experience 

'46  ■ 

4B 

Other  Activities 

— ^ — 

Enrollee  Characteristics 

-ym~ 

TflBf 

'  1654 

PROGRAM  MIX 

1.  Kupenditurea*  A  hi9h  proportion  of  total  funds 
rn  c 1 afe a rooB ,  OJT  and  othar  activities  stressing 
higher  skills  increase  *costs  per.”  A  high 

proportion  in  work  experience  nay  lower  entered  • 

ewployaent  rates  and  thereby  Increase  "costs 

per.”  *  ; 

2.  Enrol lees I  A  high  percentages  of  enrollees  in 
claasrooai  and  OJT  should  raise  expected 
entered  eeploysient  and  nondirect  placesient 

ratesi  a  high  percent  of  enrollees  in  work  j 

experience  stay  lower  entered  esiployeent  rates  ; 

but  should  raise  expected  other  positive  \ 

termination  rates. 

EMROLLEE  ClIAy^CTERISTlCS t  Higher  proportions  of 
youth^  silnoritieSf  high  school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined  ^ 

groups  Indicate  a  stress  on  services  for  those  most  1 

difficult  to  place,  and  aiay  lead  to  longer  term  f 

or  higher  coot  activities,  and  may  result  in  lower  - 

positive  termination  rates. 


1. 

Youth:  16  1  under 

_ % 

39  % 

36 

t  C.  'POST-CETA.-  WAGE  LEVELS!  Iliah  oo.t-CETA  waacs.  and 

19  -  21 

20 

2i 

_  wage  increaa%  relative  to  pre-CETA  wages  may 

2. 

Education*  B  a  under 

13 

— IT" 

.  provide  evidence  for  an  eisptiasia  on  higher  quality 

9-11 

14 

— TT" 

__  training  and  higher  skilled  jobs,  high  increases 

3. 

Minority:  Black 

37 

37 

_  may  also  indicate  m  high  proportion  of  participants 

Spanish- American 

2S 

— IT~ 

_  without  prior  work  experience. 

4. 

Handicapped 

4 

4 

5. 

Full-time  student 

14 

32 

”  D.  lOCAL  UNEMPLOYMENT  RATES:  Also  to  be  considered. 

6. 

Offender 

7 

'  V 

^  but  not  shown  in  the  interpretive  indicator  table 

Median  Wage 

1.  Post-CETA 

2.  Pre-CETA 

1 _ 

_ 

$  2.67 

rrsT 

8.88 

rrsT 

are  local  unemployaient  rates.  High  local 
unemployment  rates  may  cause  more  difficulty  In 
obtaining  placeaients,  and  may  influence  sponsors' 

_  choice  of  activities  and  characteristics  of  enrollcm 

^  (less  disadvantaged). 

•Column  to  be  filled  in  by  Federal  Representative,  see  instructions  contained  in  Attachment  1,  Section  II. 


PERFORMANCE  GUIDELINES  WORKSHEETS-  REGION  VII 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  REVIEWED 
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NOTICES 


VKIHE  SPONSOR 


reOEML  HepRESBNTATIVE 


Termination  Cluster  Formula  Rasult 

COMPARATIVE  DATA  | 

Region  VII 

National  I 

Total  Posi tlve  as  a  %  of  PPS  T.B.1.  ♦  I.b.2.  „ 

Total  Terminations  PP8  I.D. 

—ill 

_61 

1-24 

-ftt 

-fc 

70 

7ft 

nr 

9< 

Entered  Employment  as  a  PPS  I.B.l.  ^  «aa 

%  of  Total  Terminations  PPS  l.B. 

V 

74 

2 

27 

72 

43 

ftl 

Nun-Direct  Placements  as  PPS  I.D.l.b.  4  I.«.l.c.  „  iaa 

a  %  of  Total  Terminations  PPS  I.D. 

15 

21 

2ft 

43 

71 

2 

17 

23 

33 

7] 

Entered  Employment  as  a  PP^  ^.B.l.  .. 

\  of  Total  Po.itivo  pp£  l.B.l.  *  I.B.2. 

_2fl. 

97 

~ 

24 

51 

66 

uu 

Non-Diruct  as  a  1  of  PPS  I.D.l.b.  4  I.B.l.c.  ^ 

Entered  EUxploymont  PPS  l.B.l. 

56 

69 

87 

99 

100 

_ 5 

63 

66 

97 

IOC 

INTERPRETIVE  DESCRIPTIONS  See  interpret Iv  f«ctor« 
contained  In  workehcete 


EXPp^ATION/JUSTIPICATIONs 


TERNIHATIOW  CLUSTER 

Lower  total  poaltive  tcrwination  ratea  (or  high  non-positive  rates] 
way  be  due  tot 

i,  nigh  enrolliaent  of  hard-to-place  groups} 


2.  High  local  unewployment  rates; 


3.  Inadequacies  in  prograa  operation  (e.g.,  assessskent^ 
counselling,  j(^  development)  or  in  program  design 
(e.g.,  long  "holding*  periods  before  placement,  poor 
coordination  between  components,  classifying 
applicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.). 

Lower  entered  es>uloyiwent  rates t  any  of  the  above  plus 
local  emphases  on  ^employability  dovelopsient*  activities  \ 

(e.g.,  high  school  e<juivalency ;  youth  work  experience, 
etc.)  or  intertitle  transfers  leading  to  other  positive 
"terminations.*  ,  ' 

Lower  nondirect-emiiloyment  ratesi  any  of  the  above  plus 
inclusion  of  direct  job  rcl^orral  activities. 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA 

Fund  Utilisation  Cluster 

^Formula 

Result 

Region  VII 

National  { 

Carryout; 

%  of  Avallabla  Funds 

BIS  F.2 

100%  -  BiS  E,1.£.  * 

4 

9 

12 

03 

17 

H 

33 

L 

0 

Qi 

ft 

M 

13 

03 

21 

H 

53 

Administrative  Cost  Rate 

BIS  E.l.d. 

BTT  ETT.’zt  “ 

8 

11 

15 

19 

26 

3 

12 

-i! 

19 

37 

INTERPRETIVE  DESCRlPTIONi  See  interpretive  factors  contained  EXPLANATION/JUSTIPICATION: 

in  worksheets _ 


FUND  UTlLltATION  CLUSTER 

CARRY  OPT  RATEt  Hay  be  increased  byt 

•  Start  up  of  new  activities; 

.  Supplements!  appropriations  received  late  in  fiscal  yaar; 

.  Internal  administrative,  management,  processing  or  « 

contracting  problems;  ^ 

.  Unplanned  for  events,  since  original  grant  approvals. 

ADMINISTRATIVE  COST  RATE:  Hay  be  increased  byi 

•  nigh  local  cost  structure,  especially  salaries,  rent; 

.  Stress  on  activities  requiring  proportionally  more 

administration  (e.g.,  classroom  training  vs.  work 
experience) ; 

.  Stress  on  non-stipended  activltiss  (e.g.,  services); 

.  Heavy  reliance  on  contractors,  subgrants ; 

•  Unplanned  carry  out  of  non-adminietrative  coats; 

.  Heavy  use  of  computers  or  other  hardware; 

.  High  indirect  cost  rates. 
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NOTICES 


PEWrOKMMICE  GUIDELINES  WORKSUELTS-  REGION  VI II 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  REVIEWED 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA  | 

Termination  Cluster 

Formula 

Result 

Region 

VIXI 

National 

Total  Positive  as  a  %  of 
Total  Terminations 

■  fM'T.a.l.  «  i.B.S.  ..  ... 
tps  i.s:  * 

59 

Ul 

75 

n 

77 

«3 

83 

II 

93 

L 

21 

0l 

59 

M 

70 

Q3 

78 

H 

9- 

Entered  Esplcy^nt  as  a 
%  of  Total  Terminations 

-ppTTTSp^-TToo 

PpS  s.B. 

23 

42 

47 

59 

77 

2 

22 

yj. 

43 

Si 

Non-Direct  Placements  as 
a  %  of  Total  Terminations 

i  X  100 

PPS  I.B. 

23 

30 

40 

46 

59 

2 

17 

23 

33 

71 

Entered  Employment  as  a 
%  of  Total  Positive 

PPS  I.B.l.  _ 

PPS  t.li.i.  ♦  l.b.S.  * 

27 

55 

62 

77 

95 

3 

34 

51 

66 

ic: 

Non-Direct  as  a  1  of 
Entered  Eaq>loymerit 

PPS  J.B.l.b.  +  t.B.l.c.  .. 

PPS  I.B.l. 

36 

60 

89 

100 

100 

5 

63 

86 

97 

IOC 

EXP|JINAT10N/JUST1 PICATION i 


TERMINATION  CLUSTER 


Lower  total  positive  terwination  rates  (or  high  non-positive  ratesi 
may  be  due  to: 

1.  High  enrollMent  of  hard-to-place  groupsi 


2.  High  I0C4I  uneaployaent  rates; 


Inadequacies  in  prograa  operation  (e.g.«  assessiaent, 
counselling,  job  developwiit)  or  in  prograa  design 
(c.g.,  long  "holding*  periods  before  placenent,  poor 
coordination  between  conponents,  classifying 
a]>plicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.). 


entered  ci 


‘mploywent  rates:  any  of  thd  above  plus 
1  ^employability  development*  activities 


Lower 

local  emphases  on  ^employability  development*  activities 
(e.g.,  high  school  equivalency:  youth  work  experience, 
etc.)  or  intertitle  transfers  leading  to  other  positive 
"terminations.* 

Lower  nondirect-emtilovment  rates;  any  of  the  above  plus 
I iM*tti*:ion  direct  iol>  referral  activi  ties. 
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NOTICES 


PRIHE  SPONSOR 


FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA 

PufMi  utilization  Cluster 

Formula 

Result 

Region  VIII 

National 

Carryouti 

%  of  Available  Funds 

BIS  F.2 

-  if?  E.'l.f:  »  io® 

T 

Wl 

14 

21 

Qi 

27 

H 

39 

j1 

Ol' 

6 

M 

13 

03 

21 

U 

53 

Administrative  Cost  Rate 

BIS  E.l.d. 

bis  Ei7!dl  *  ^®® 

9 

13 

It 

20 

28 

12 

It 

19 

37 

FUND  UTILISATIOH  CLUSTER 

CARRY  OUT  RATEt  May  be  increased  by* 

.  Start  up  of  new  actlvitieai 

.  Suppleiiental  appropriations  received  late  in  fiscal  year} 
.  Internal  adainistrative,  nana^eeentf  processing  or 
contracting  probleais; 

.  Unplanned  for  events,  since  original  grant  approvals. 

ADMINISTRATIVE  COST  RATE:  May  be  increased  by» 

.  High  local  cost  structure,  especially  salaries,  rent} 

.  Stress  on  activities  retjuiring  proportionally  sore 
administration  (e.g.,  classroom  training  vs.  work 
experience) i 

.  Stress  on  non-stipended  activities  (e.g.,  services)} 

.  Heavy  reliance  on  contractors,  subgrantst 
.  Unplanned  carry  out  of  non-adninistrative  costsi 
.  Heavy  use  of  computers  or  other  hardware} 

.  High  indirect  cost  rates. 


EXPLANATXON/JUSTlFICATlONt 


PRIME  SPONSOR; 


FEDERAL  REPRESENTATIVE i 


Cost  Cluster 

Formula 

Results 

Region  VIII 

National 

Cost  per  positive  termination 

DIS  F.2. 

L 

H 

^1 

“ 

Qi 

M 

03 

PPS  .1.8.1.  *  t.b.lJ 

621 

9oa 

1276 

1734 

8598 

355 

1269 

1888 

2606 

8598 

Cost  per  entered  employment 

BIS  P.2. 

722 

1610 

1916 

3058 

1334t 

405 

2857 

4254 

6586 

>5,705 

prs  i.B.i. 

Cost  per  non-direct  placeatent 

BIS  F.2. 

1271 

883 

PPS  I.B.l.b.  *  l.B.l.C. 

U04 

2868 

3518 

1334t 

[_3693 

5828 

8235 

i5,705 

Comparative  Data 


IHTLWKETIVE  UESCRIPTION:  See  interpretive  factor.  contain«l 
in  worksheets _ 

COST  CLUSTER 

Higher  costa  i>er  i>ositivc  outcosie  siay  be  due  to  any  of  the 
factors  leading  to  lowered  ^sitfve  termination  rates,  (see 
teribination  cluster  worksheet)  plus; 

1.  High  local  cost  structures  for  standard  items 
(c.g.,  wage  rates,  rental  coats)} 

2.  Use  of  more  costly  resources  (e.g.,  proprietary 
scluiols,  computers,  special  equlf>ment)} 

3.  ttmphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development; 

4.  Higher  than  minimum  rates  for  participant  stipends, 
wages; 

5.  Stress  on  longer  term  training  for  higher  skill* 

}obs. 


Higher  Costs  Per  Entered  Emnloymont  may 
factors  contrll^tinqt^  higher  positive 


be  due  to  any  of  the 
outcome  costs 


indicated  above  plus  those  leading  to  lowered  entered 
employment  rates  (see  termination  cluster  worksheet). 

Higher  Costs  Per  Nondirect  Placement  may  be  due  to  any 
of  the  factor's  contributing  to  higher  positive  outcome 
costs  indicated  above  plus  the  Inclusion  of  direct  job 
referral  activities. 


EXPLAN ATI ON/ J  UST 1 F  fCAT 1 ON » 
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NOTICES 


PEIME  SPOHSOEj  _ 

INTEEPEETIVE  FACTORS 


PEOBRAX  REPRESENTATIVE  ^  - 
py  1974  (9/76) 

Actual  Data  •  USE  OF  INTERPRETIVE  FACTORS 


A.  Program  Mia 


1.  Percent  of  Eapendituraa 

Clasarooa 

On»job  training 

Public  Service  Enployaent 

Work  Experience 

Services 

Other  Activities 


2.  Percent  of  Cunulatlve 
Enrol leeota _ 


Clasarooai  -  prlne  sponsor 
Classrooa  •  Voc.  Educ. 

On- job  training 
Public  Service  b^loynent 
Work  Experience 
Other  Activities 


B.  Enrollec  Characteristics 


Sponsor* 


Regionvill  National 


35 

17 


30 

9 

“IT” 

“?r“ 

“T” 

“T” 

TTOT 


1.  Expenditures?  A  high  proportion  of  total  funds 
in  classroon,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per."  A  high 
proportion  in  «N>rk  experience  nay  lower  entered 
enploynent  rates  and  thereby  increase  "costs 
per." 

2.  Enrol lees?  A  high  percentages  of  enrollees  in 
classroon  and  OJT  should  raise  expected 
entered  enploynent  and  nondirect  placenent 
rates)  a  high  percent  of  enrollees  in  ««ork 
experience  nay  lower  entered  enployaent  rates 
but  should  raise  expected  other  positive 
termination  rates. 

B.  ENROLLEE  aiARACTERISTlCS t  Higher  proportions  of 
youth7  ninorities,  Kigh  school  dropouts,  handi- 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  bn  services  for  those  most 
difficult  to  place,  and  nay  lead  to  longer  tern 
or  higher  cost  activities,  and  nay  result  in  lower 
positive  termination  rates. 


1.  Youth?  18  6  under  t 

-  21  '  ' 

2.  Education)  8  6  under 

9-11 

3.  Minority)  Black 

Span  ish-AMr  lean 

4.  Handicapped 

5.  Pull-tine  student 

6.  Offender  _ 


C.  Median  Wage 

1.  Post-CETA  8 

2.  Fre-CBTA  t 


$2.84 


C.  V POST-CETA,  WAGE  LEVELS;  High  post-CETA  wages,  and 

wage  increase  relative  to  pre-CETA  wages  nay 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  j<^s,  high  increases 
nay  also  indicate  a  high  proportion  of  participants 
without  prior  %#ork  experience. 

D.  LOCAL  UHEfiPLOYMEIfT  RATES)  Also  to  be  considered, 
but  not  shown  in  the  interpretive  indicator  table 
are  local  uneaiploynent  rates.  High  local 
unenploya«nt  rates  nay  cause  more  difficulty  in 
obtaining  placements,  and  nay  influence  sponsors' 
choice  of  activities  and  characteristics  of  enrolleei 
(less  disadvantaged). 


"Column  to  be  filled  in  by  Federal  Representative.  See  instructions  contained  in  Attachnent  1,  Section  11. 


PERFORMANCE  CUIDELIWES  WORKSHEETS-  REGION  IX 


PRIME  SPONSOR 


FEDERAL  REPRESENTATIVE 


DATE  REVIEWED 
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NOTICES 


PRIME  SPONSOR 


rEOE|Ua4  REPRESENTATIVE 


Teiminstion  Cluster  Formula  Result 

ll.9ion  IX 

National  j 

Total  Positive  as  a  1  of  PPS  l.B.l.  ♦  i.H.2. 

Total  Tcrcinatloni  Pf^  I.R. 

X 

22 

% 

87 

03 

78 

IT 

99 

L 

21 

Ol 

S9 

tr 

70 

«3 

78 

n 

yj 

Entered  Emplov"  >t  ae  a  PPS  T.B.l.  ^ 

%  of  Total  TeriNi nations  PPS  I.S. 

10 

27 

1« 

44 

78 

2 

22 

32 

4^ 

8‘ 

K^nT^oTrect  piac^^r.tw  as  PPS  l.iiTl.b.  ♦~i.>.l.c.  ^ 

a  %  of  Total  TtJrei«»ations  PPS  T.B, 

6 

18 

25 

36 

55 

2 

IT 

23 

33 

71 

Entered  Ewiovrrnt  as  a  PPS  l.B.l.  « 

%  of  Total  Positive  PPS  l.B.l.  *  I.R.2. 

11 

47 

64 

68 

3 

34 

66 

Mon>l>irect  as  a  i  ot  PPS  I.B.l.b.  *  I.B.l.c.  ^ 

Entered  Caployr.v'nt  f’PS  l.B.l. 

i» 

86 

9$ 

100 

5 

61 

86 

97 

10( 

COMPARATIVE  DATA 


INTERPRETIVE  DCSCRlPTlONt  Sec  Infrpretiv  factors 
cont«if»e<f  itt  1» 


TERMINATION  CLUSTER 


LcMer  total  positiv  tcminatlon  ff  (or  hl^h  non-posltivo  r«t«« 
May  t«  due  tot 

1.  ui^li  enrollMnt  of  hard-to-pIac«  groupsi 


Hl9h  local  uneof loyMont  ratosj 

Inadoquaclos  la  pro9raB  operation  (e.g.^  aRRoaiaient, 


•  iftP 

counselling,  ju>  developaeat)  or  in  progran  design 
(e.g.,  long  "holding*  periods  before  placesient,  poor 
coordination  between  components,  classifying 
applicants  as  participants  prior  to  actual  anrollmant 
in  program  activitlas,  etc.). 


enterad  emnloy^nt  rataat  any  of  tha  above  plua 
local  amphasM  on  ^amployabllity  davelopment*  activitiea 
(a.g.,  high  school  eguivslencyi  youth  uork  experianeo, 
etc.)  or  iatertitle  tranefera  leading  to  other  poeitive 
*teminationa.* 


Lower  nondir^t»emplovsient  rates  >  any  of  tha  above  plea 
inclusion  of  direct  referral  activities* 


EXPLANATION/ JUSTI P ICAT I ON  x 


PRIME  SPONSOR 


PEOKRAL  REPRESENTATIVE 


COMPARATIVE  DATA 

Fund  Utilisation  Cluster 

Formula 

tesult 

Region  IX 

National  | 

Carryout! 

%  of  Aval labia  Funds 

BIS  F.2 

»»««  -  aU  ITf.t:  »  »•« 

0 

10 

18 

03 

24 

U 

53 

0i 

• 

M 

13 

0l 

21 

■ 

$3 

Administrative  Coet  Rate 

*18  E.i.j.  ,, 

■ 

10 

16 

IS 

20 

26 

3 

12 

16 

18 

17 

INTERPRETIVE  DESCRIPTION!  See  interpretive 
^  in  >#orlisheets 


fsctors  contsined 


FUND  UTILIXATION  CLUSTER 


CARRY  OUT  RATE  I  Msy  be  increased  byt 


BXPLANATlON/JOETXrXCATION  t 


Start  up  of  new  sctlvitiest 

Supplsmsntal  appropriations  rscsived  late  in  fiscal  yeari 
Internal  adniniatrative,  managemant,  processing  or 
cxMttracting  problems | 

Unplanned  for  events,  sines  original  grant  approvals. 


ADMINISTRATIVE  COST  RATEt  Hay  bs  incraasad  byt 


•  High  local  cost  structurs,  sspecislly  salaries,  rsnti 

•  Stress  oo  activities  requiring  proportionally  more 
administration  (e.g«,  classroom  training  vs.  «#ork 
axperiance) t 

.  Stress  on  noo>stipendsd  activities  (s.g.,  services)! 

.  Heavy  reliance  on  contractors,  stA>9rsntai 

•  Unplannsd  carry  out  of  non*-administrative  coatai 
.  Heavy  usa  of  computers  or  othar  hardwarei 

.  High  indirect  cost  rates. 
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NOTICES 


PRIHE  SPONSOR! 


FEOCRAL  REPRESENTATIVE! 


Comparative  Data 


T — r~5r“ 

3Sel  1386 


Qj  I  "ff 
16361  24841  484 


T— rur-TH — [-Qj-r-ir 

3S5  I  126»|  1888  2606  I  8698 


2236  1  2979  1  42961  61891  1502 


36931  5628  I  8235  165.70 


EXPLANATION/JUSTlrlCATlON i 


Cost  Cluster 


Cost  per  positive  termination 


Cost  per  entered  employment 


Cost  per  non-direct  placement  ♦  t.B.l.c,' 


BIS  P.2. 

PPS  I.B.l.  *  l.B.2. 


COST  CLUSTER 


Higher  costs  per  positive  outcome  auiy  be  due  to  any  of  the 
factors  leading  to  lowered  positive  termination  rates,  (see 
termination  cluster  %#orksheet)  plus: 

1.  •  High  local  cost  structures  for  standard  Items 

(e.g.,  wage  rates,  rental  costs) | 

2.  Use  of  sK>re  costly  resources  (e.g.,  proprietary 
schools,  computers,  special  csquip«mnt){ 

3.  Emphasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  eag>loyability 
development; 

'  4.  Higher  than  minimum  rates  for  participant  stipends, 
wages: 

5.  Stress  on  longer  term  training  for  higher  skill' 
jobs. 


Higher  Costs  Per  Entered  Employment  stay  be  due  to  any  of  the 
factors  contributing  to  higher  positive  outcoaie  costs 
indicated  above  plus  tlw^se  leading  to  lowered  entered 
em{>loyment  rates  (see  termination  cluster  worksheet). 


Higher  Costs  Per  Wondirect  Placement  isay  be  due  to  any 
of  the  factors  contributii:g  to  higher  positive  outcome 
costa  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 


PRIME  SPONSOR: 

INTERPRETIVE  FACTORS 


___  FEDERAL  REPRESENTATIVE  _ 

FY  1976  (9/76) 

Actual  Data  USE  OF  INTERPRETIVE  FACTORS 


A.  Program  Mis 


Sponsor*  Region  IX  National 


PROGRAM  MIX 


1 .  Percent  of  EKi*enditures 

Classroom  _ 

On-jcR>  training  _ 

Public  Service  Employment 

Work  Experience  _ 

Services  _ 

Other  Activities  _ 

100% 

2.  Percent  of  Cumulative 

Enrol Iments _ 


Classroom  -  prime  sponsor  ___ 

Classroom  -  Voc.  Educ. 

On- job  training 

Public  Service  tmployrnent 

Vtork  Ex|>erience 

Other  Activities  - 

100% 


0.  Enrol lee  Characteristics 


35 


“TT" 
— 5~ 

36 

_ a_ 


JJL 

9 

11 

40 


TTiir 


— i— 

—vs— 

- T— 

TW 


1.  Expenditures:  A  high  proportion  of  total  funds 
in  classroom,  OJT  and  other  activities  stressing 
higher  skills  increase  "costs  per.”  A  high 
proportion  in  work  experience  may  lower  entered 
employment  rates  and  thereby  increase  "costs 
per. " 

2.  Enrol lees:  A  high  percentages  of  enrollees  in 
classroom  and  OJT  should  raise  expected 
entered  employment  and  nondirect  placesient 
rates;  a  high  percent  of  enrollees  in  work 
experience  may  lower  entered  employment  rates 
but  should  raise  expected  other  positive 
termination  rates. 

ENROLLEE  CIIA^CTERISTICSi  Higher  proportions  of 
youth,  minorities,  high  school  dropouts,  handi¬ 
capped,  offenders  and  other  locally  determined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  place,  and  may  lead  to  longer  term 
or  higher  cost  activities,  and  may  result  in  lower 
positive  termination  rates. 


1.  Youth:  18  6  under  % 

19  -  21  _ 

2.  Education:  8  4  under 

9-11  _ 

3.  Minority:  Dlack 

Spanish-American 

4.  Ilandicapi>cd 

5.  Full-time  student 

6.  Offender  _ 


C.  Median  Wage 

1.  Post-CETA  $ 

2.  Pte-CETA  r 


$3.10  $2.88 

?2.7i  wrer 


C.  V POST-CETA.  WAGE  LEVELS:  Migi.  post-CETA  wages,  and 

wage  increase  relative  to  pre-CETA  wages  may 
provide  evidence  for  an  emphasis  on  higher  quality 
training  and  higher  skilled  jobs,  high  increases 
may  also  Indicate  a  high  proportion  of  participants 
without  prior  work  experience. 

D.  LOCAL  UNEMPLOYMENT  RATES;  Also  to  be  considered, 
but  not  shown  in  the  interpretive  indicator  table 
arc  local  unemployment  rates.  High  local 
unemployment  rates  may  cause  more  difficulty  in 
obtaining  placements,  and  may  Influence  sponsors' 
choice  of  activities  and  characteristics  of  enrolled 
(less  disadvantaged). 


•Column  to  be  filled  in  by  Federal  Representative.  See  instructions  contained  in  Attachment  1,  Section  II. 


1 


43273 


FEDERAL  REGISTER,  VOL.  42,  NO.  166 — FRIDAY,  AUGUST  26,  1977 


NOTICES 


PEHFORHXHCE  GUIDELINES  WORKSHEETS-  REClOH  X 


PRIME  SPONSOR 


FEDERHL  REPRESENTATIVE 


DATE  REVIEWED 


PRIME  SPONSOR 


PEDERAL  Pj:PRESENTATJVE 


Termination  Cluster 

Formula 

Result 

Region 

X 

National 

VtfVI  ■  JTTTt 

M 

E9 

-TT 

IM 

M 

M 

Efl 

PPS  I.B.  "  ■■■ 

KQ 

KQ 

63 

■n 

■£1 

HI 

El 

El 

EE 

PPS  I.B.l.  100 

■N 

22 

32 

*3 

PPS  I.B. 

mS 

25 

31 

36 

60 

2 

PPS  l.B.l.b.  ♦  I.B.l.C.  . 

BH 

HI 

HI 

HI 

HI 

■i 

B 

m 

m 

B 

PPS  I.B.  * 

HQ 

■9 

D 

El 

IS 

■1 

Entered  Employment  as  a 
%  of  Total  Positive 

■1 

1! 

m 

m 

B 

B 

B 

■ 

66 

1 

Non*Direct  as  a  %  of 

■R 

HI 

HI 

HI 

■I 

Enteied  Kiuployiiicnt 

IS 

El 

ES 

;E9 

EH 

M 

‘3 

1  86 

97 

iOO 

COMPARATIVE  DATA 


INTERPRETIVE  DESCRIPTION:  Sec  interpretive  factors 
contained  in  worksheete 

TERMINATION  CLUSTER 

Lower  total  positive  termination  rates  (or  high  non-positive  rates 
atay  be  due  toi 

1.  High  enrollment  of  hard-to-place  groupsi 


EXPLANATlON/JUSTIFICATlONt 


2.  High  local  unemployment  rates; 


3*  Inadequacies  in  program  operation  (e.g.«  assessment, 
counselling,  job  development)  or  in  program  deaigm 
(e.g.,  long  "holding*  periods  before  places^nt,  poor 
coordination  between  components,  classifying 
applicants  as  participants  prior  to  actual  enrollment 
in  program  activities,  etc.)« 

Lower  entered  employment  rates:  any  of  the  above  plus 
local  emphases'un  "employability  developa^ent*  activities 
(e.g.,  high  school  oquivalcncy;  youth  work  experience, 
etc.)  or  intertitle  transfers  leading  to  other  positive 
" terminations . * 

Lower  nondirect- employment  rates:  any  of  the  above  plus 

i nc Ins ( on  ctt  direct  job  referral  act ivities* 
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NOTICES 


FRIMB  SrONSOR 


FEDERAL  REPRESENTATIVE 


COMPARATIVE  DATA  I 

Fund  Utilisation  Cluster 

Forsnila 

Result 

Revlon  X  1 

1  Nstionsl  1 

Carryouts 

%  of  Available  Fui»ds 

RIS  F.2 

*®®*  ■  S15  iiT.l.  »  1®® 

— IT 

7 

"or 

12 

IT’ 

20 

Q3 

25 

H 

44 

L 

0 

Qi 

8 

H 

13 

O3 

21 

H 

53 

Administrative  Cost  Rate 

BIS  E.l.d. 

i»  itiT.a:  »  ^®® 

7 

IS 

17 

19 

20 

3 

12 

16 

19 

37 

INTERPRETIVE  DESCRIPTIONS 

FUND  UTIHIATION  CLUSTER 


EXPLANATION/JUSTIPICATION I 


CARRY  OUT  RATES  Hay  be  increaeed  byi 
«  Start  up  of  new  actWitieai 

•  SuppioMntal  appropriations  received  late  in  fiscal  yean 
.  Internal  adninistrativst  nansgeaent,  processin9  or 

contracting  problensi 

•  Unplanned  for  events*  since  original  grant  approvals. 

ADMINISTRATIVE  COST  RATEs  Hay  be  increased  bys 

.  High  local  coat  structure*  especially  salaries*  rent# 

.  stress  on  activities  requiring  proportionally  aors 
adainistration  (e.g.*  classrooa  training  vs.  work 
esperiencel | 

.  Stress  on  non-stipended  activities  (e.g.*  services)! 

.  Heavy  reliance  on  contractors*  subgraotsf 

•  Unplanned  carry  out  of  noo-adkiiniatrative  costs} 

.  Heavy  use  of  coaputers  or  otlier  hardware} 

.  High  indirect  cost  rates. 


PRine  SPONSOR} 


PEOERAJ.  REPRESENTATIVE! 


Comparative  Data 


Cost  Cluster 


I  I 

612  1856 


1987  1  2S93i  5981] 


355 


Oi  I  H — pjj-pr- 

1269  1888  2606  8598 


Cost  per  positive  termination 


RIS  P.2. 

pFsTriTTmrwTT: 


Cost  per  entered  employment 


BIS  P.2. 
tPS  l  .R7r. 


I  2048  [  4626  [  6385  1  763l|l0795|  863  |  36931  5628  1  6235  ^>7051 


INTERPRETIVE  DESCRIPTIONS 


COST  CUISTER 


e  interprotive  factors  contained 
%#orksheeta 


Higher  costa  per  positive  outrnas  may  be  due  to  any  of  the 
factors  leadi^  to  lo%rered  positive  termination  rates*  (see 
termination  cluster  worksheet)  plust 


EXPLANATION/ JUSTIFICATION i 


1.  High  local  cost  structur.ea  for  standard  items 
(e.g.,  wage  rates,  rental  costs)} 

2.  Use  of  BH>re  costly  resources  (e.g.,  proprietary 
scisools,  computers,  special  equipment)} 

3.  imiNiasis  on  supportive  services  (transportation, 
day  care,  etc.),  classroom  training,  employability 
development} 

4.  Higher  than  minimum  rates  for  participant  stipends* 
wages} 

5.  Stress  on  longer  term  training  for  higher  skill* 
iobs. 


Higher  Costs  Pet  Entered  totluyment  may  be  duo  to  any  of  the 
factors  contributing  to  liigiier  pMltlve  outcome  costs 
indicated  above  plus  tliose  leading  to  lowered  entered 
e«ploysM.*nt  rates  (see  termination  cluster  %K>rksheet) . 


Iligiter  Costs  Per  Hondirect  Placement  may  be  due  to  any 
of  ll»e  factors  contributing  to~ higher  positive  outcome 
costs  indicated  above  plus  the  inclusion  of  direct  job 
referral  activities. 
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NOTICES 


PKIH£  SPONSOR  I 


INTTRPRKTiyE  KACTOHS 


rCOCRRL  REPRBSENTATIVB 

rr  1976  (9/7S) 

Actual  Data  USB  OP  IWTgRPI 


USE  OP  IWTgRPRKTIVE  FACTORS 


A.  Pro<no*m  Hia 


1 .  Percent  of  BKiwitditurea 


ClaaaroOM 

On-job  treininti 

Public  Service  EiiiployiMent 

Work  Experience 

Services 

Other  Activities 


ClaxsrooM  -  prime  siK>nsor 
Classroom  -  Vuc.  Lduc. 
On-job  training 
Public  Service  Employment 
Work  Exf>crience 
Other  Activities 


B.  Enrollee  CItnrart  ct  i  at  tes 

1.  Youthi  18  4  uiiUur 

19  -  21 

2.  Educations  8  4  under 

9-11 

3.  Ninoi'ityi  Black 

Spanish- Aaetr  lean 

4.  llan<ticdp|»cd 

b.  iull-time  student 
4.  Of  tender 


A.  PWOCRAM  MIX 

1.  Kx|»enditurest  A  hiqh  proportion  ol  total  funds 
Tn  clasaroon«  OJT  and  other  activities  stressin9 
hl«jher  skills  increase  "costs  per."  A  hi9h 
pioportioM  in  %K>rk  experience  may  loeer  entered 
emi^loyiaenl  rates  and  thereby  incveaae  "coata 
l>ef  .  • 

Knrollceai  A  high  percentages  of  enrollces  in 
cTassrooai  and  OJT  ahould  raise  expected 
entered  cs9>]oyaient  and  nondirect  placeaient 
ratoai  a  high  percent  of  enrol lees  in  work 
experience  nay  lo%#er  entered  cagtloyswnt  rates 
but  should  cslsc  ext>ucted  other  positive 
,  termination  rates. 

B.  ENROl.LEE  CIIAW^CTKHISTlCSt  Higher  proportions  of 
youth*  mif^rltiesi  high  school  dropouts*  handl- 
cap|>ed«  offenders  and  other  locally  detemined 
groups  indicate  a  stress  on  services  for  those  most 
difficult  to  plscc*  and  may  lead  to  longer  tens 

or  higher  coat  activities*  and  mmy  result  in  lower 
positive  termination  rates. 

C.  POPT-rtrrA*  wage  LKVEI.S:  High  post-CETA  wages*  and 
wage  "incrcas«i2  relative  to  pre-CLTA  wages  isay 
provide  evidence  for  an  emphasis  on  higlier  quality 
training  and  higiter  skilled  jol>6*  high  increaaea 
My  also  indicate  a  high  proi>urtion  of  participants 
witiMHit  prior  work  experience. 

D.  UX;Ab  UNnMPI/)YMrWT  RATES »  Also  to  be  considered* 
but  not  shown  in  the  interpretive  indicator  table 
are  local  uncmploysient  rates.  High  local 
unemployMnt  rates  may  cause  siore  difficulty  in 
obtaining  placcsHrnta*  and  ixay  influence  aiK^nsors* 
choice  of  activities  and  characteristics  of  cnrollaa 
(less  disadvantaged). 


to  be  filled  in  by  Fudersl  Representative.  See  Instructions  contained  in  Attaclisient  X*  Section  XI. 


FEDERAL  REGISTER,  VOL  42,  NO.  166— FRIDAY,  AUGUST  26,  1977 


NOTICES 


43277 


Attachment  n 

INDICATORS 

The  Indicator  utilized 'in  this  process  were 
developed  by  the  Performance  Indicators 
Work  Group  as  a  result  of  its  deliberations 
during  December  1976  and  January  1977. 
However,  it  was  determined  that  use  of  the 
“Earnings  Clustre"  Indicators,  would  not  be 
practical,  since  data  would  not  be  available 
from  the  appropriate  planning  documents 
(PPS  and  BIS).  Additionally,  the  "Expendi¬ 
ture  Rate"  indicator  was  omitted. 

Termination  Rate  Cluster.  This  group  of 
measures  indicates  the  proportions  of  par¬ 
ticipants  leaving  the  CETA  program  achiev¬ 
ing  the  several  types  of  objectives  Included 
in  the  employment  and  positive  outcome 
categories.  Obviously,  no  one  of  the  measures 
is  sufiBcient  in  analyzing  or  explaining  par¬ 
ticipant  outcomes.  The  cluster  must,  in  addi¬ 
tion,  be  examined  in  relation  to  costs,  and 
the  interpretive  factors. 

1.  Positive  termination  rate: 

Total  positive  terminations 

_ Z. _  V  lOO 

Total  terminations 

This  Indicator  provides  a  broad  measure 
of  planned  prfogram  success  in  accomplish¬ 
ing  multiple  goals.  The  inclusion  of  other 
positive  terminations  recognize  that  pro¬ 
grams  may  have  additional  planned  out¬ 
comes  other  than  placement.  The  Inclusion 
of  intertltle  transfers  in  other  positive  ter¬ 
minations  and  total  terminations  represents 
a  troublesome  distortion  which  cannot  be 
avoided. 

2.  Entered  employment  rate-total  ter¬ 
minations  based: 

Entered  employment 
Total  termination  ^ 

This  indicator  provides  a  general  measure 
of  the  degree  CETA  participation  will  result 
in  emplojrment.  The  measure  disregards  the 
amount  of  service  provided  or  the  source 
of  placements,  but  these  factors  should  be 
taken  into  account  during  analysis  of  this 
indicator. 

3.  Entered  employment  rate-total  positive 
terminations  based: 

Entered  emplo3ment 

_ _ y  100 

Total  positive  terminations 

This  indicator  provides  another  method  of 
analyzing  the  degree  CFTA  participation  will 


result  in  employment.  It  focuses  on  the  In¬ 
ternal  composition  of  positive  outcomes. 

4.  Nondirect  placement  rate-total  termi¬ 
nations  based: 

Nondirect  placements  ^ 

Total  terminations 

This  indicator  measures  the  degree  employ¬ 
ment  will  result  for  participants  who  re¬ 
ceive  more  than  a  minimal  level  of  CETA 
services.  The  obtained  employment  group 
is  Included  to  take  into  account  those  par¬ 
ticipants  who  receive  significant  CETA  serv¬ 
ices  and  gain  employment  but  for  whom  the 
sponsor  cannot  take  actual  placement 
credits. 

5.  Nondirect  placement  rate-total  entered 
employment  based: 

Nondirect  placements 
Entered  employment  ^ 

This  indicator  is  another  measure  of  em¬ 
ployment  results  for  participants  receiving 
more  than  minimal  CETA  services.  It  high¬ 
lights  the  composition  of  the  entered  em¬ 
ployment  category. 

Cost  cluster..  This  group  of  indicators 
measures  the  costs  in  achieving  positive  out¬ 
comes  in  CETA  programs.  This  cluster  con¬ 
sists  of  the  rates  of  total  expenditures  to 
termination  categories.  In  addition,  the  cost 
factors  must  be  related  to  quality  outcome, 
difliculty  of  clientele,  and  external  factors. 
It  should  be  noted  that  the  ratios  for  the 
indicators  in  the  "cost  cluster”  used  to  com¬ 
pute  the  quartile  reference  points  and  for 
planning  goals  do  not  represent  actual  dol¬ 
lars  spent  or  planned  to  be  spent  on  each 
enrollee  terminating  positively,  each  en- 
rollee  entering  employment  and  each  en¬ 
rollee  nondlrectly  placed.  This  is  because 
total  accrued  or  planned  expenditures  into 
which  the  outcomes  are  divided  refiect  costs 
for  all  aspects  of  the  prime  sponsor’s  pro¬ 
gram  rather  than  for  any  specific  outcome. 
Actual  costs  can  only  be  obtained  by  appro¬ 
priate  longitudinal  studies.  The  purpose  of 
these  Indicators  is  to  provide  a  common  base 
for  comparing  prime  sponsors.  Therefore, 
the  high  "costs"  obtained  for  these  indi¬ 
cators,  especially  the  highest  national  and 
regional  reference  points  for  the  cost  per 
entered  employment  and  the  cost  per  non¬ 
direct  placement,  and  those  which  may  be 
obtained  for  planning  goals,  should  be  un¬ 
derstood  in  this  context. 
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1.  Cost  per  positive  termination: 

Planned  expenditures 
Total  number  of  positive  terminations 

This  indicator  provides  a  measure  of  costs 
in  relation  to  broad  program  results,  includ¬ 
ing  accomplishment  of  goals  other  than 
placement  in  emplo3rment. 

2.  Cost  per  entered  employment: 

Planned  expenditures 
Total  number  entering  employment 

This  measure  relates  costs  to  the  total  em¬ 
ployment  resiUts  of  a  CETA  program. 

3.  Cost  per  nondirect  placement: 

Planned  expenditures 
Total  number  of  nondirect  placements 

This  indicator  provides  a  measure  of  costs 
in  relation  to  employment  results  for  par¬ 
ticipants  receiving  CETA  services  beyond  in¬ 
take,  assessment,  and  job  referral  placement. 

Fund  utilization  cluster.  These  indicators 
measure  the  extent  total  available  funds  will 
be  utilized  during  the  fiscal  year.  Since  there 
is  general  concern  about  reducing  the  amount 
of  unspent  funds  remaining  at  the  end  of 
each  fiscal  year,  a  specific  measure  related  to 
planned  carry-out  for  the  year  is  included.  In 
addition,  an  indicator  on  administrative  costs 
is  Included.  Regulations  prohibit  administra¬ 
tive  cost  rates  of  more  than  20  percent  of 
total  planned  costs  for  all  program  activities 
other  than  PSE. 

1.  Carry-out  rate: 

Planned  carry-out  funds 

- n-cr —  X  100 

Total  funds  available 

This  indicator  describes  trends  In  spending 
rates. 

2.  Administrative  cost  rate: 

Planned  administrative  costs 
Planned  expenditures 

This  measure  relates  administrative  costs  to 
the  overall  expenses  of  a  program. 

Signed  at  Washington,  D.C.,  this  11th 
day  of  August  1977. 

Robert  J.  McConnon, 
Deputy  Assistant  Secretary  for 
Employment  and  Training 
Administration. 
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